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ABSTRACT 



Reliability Improvement Warranties illustrate a new 
contractual technique for improving reliability by providing 
a strong monetary incentive to the contractor. This incen- 
tive, however, also places additional monetary risk on the 
contractor. Industry has expressed mounting concerns over 
this risk. This thesis contains an examination of the 
relationship between government benefits and contractor 
risk. Existing and proposed RIW contracts are evaluated 
in regard to the type of equipment under warranty, the use 
of exclusions, penalties for non-compliance, and RIW price. 
The results of the analysis illustrate how RIW is being 
used by the government. 
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I . INTRODUCTION 



The need to improve combat effectiveness and reduce 
skyrocketing equipment support costs has been recognized 
as a major problem by the Department of Defense. The 
problem exists because performances and acquisition costs 
have become the driving factors behind the procurement of 
new weapon systems. Reliability requirements have not 
been integrated with the design effort and usually have 
been designated for demonstration only at the conclusion 
of full scale development. The demonstration was normally 
conducted in a laboratory environment that had little 
resemblance to the actual environment the equipment was 
faced with in the field. Contractors viewed this demonstra- 
tion as the only reliability hurdle their equipment had to 
pass and were strongly motivated to design to the benign 
test environment. Because the government was intimately 
involved with the contractor during the design effort and 
frequently initiated design changes, responsibility for 
reliability became diffused. Original reliability standards 
were not enforced and sometimes were lowered when it became 
apparent they could not be met. Contractors, who have been 
capable of designing and producing reliable hardware, did 
not do so because their rewards were realized from producing 
a high performance system for the least possible cost and 
not from the production of reliable equipment. 
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A. OBJECTIVE OF RIW 



In a joint memorandxim dated 14 August 1974, the Director, 

Defense Research and Engineering and the Assistant Secretary 

of Defense (I&L) stated that the objective of RIW is: 

"... to motivate and provide an incentive 
to contractors to design and produce 
equipment which will have low failure 
rates and low repair costs during field/ 
operational use. This technique attempts, 
through the use of contractual agreements 
(which extend for several years after 
government acceptance of the equipment) 
to provide an incentive for contractors 
to improve the reliability of their 
equipment and to reduce repair costs in 
order to maximize their profits,. Thus 
the intent of the RIW contracting technique 
is to realize improved operational 
reliability and maintainability of DOD 
systems and equipments for each additional 
dollar that the contractor earns. For 
these reasons, a RIW is not a maintenance 
contract and should not be used for this 
purpose . " 

The proper application of RIW should therefore result 
in the acquisition of equipment that has been designed and 
produced to have a low initial failure rate in the field . 

This initial failure rate will be lowered even further during 
the warranty period due to the incentive the RIW provides 
the contractor. The maximum benefits from RIW are therefore 
expected to be realized during the initial years of an 
equipment deployment. At the end of the warranty period 
the government can either extend the warranty or assume its 
own organic maintenance. It is anticipated that at the end 
of the warranty period the reliability of the equipment will 
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have grown to a point where the nxoitiber and costs of repairs 
are much lower than if the government had not applied the 
warranty and assumed its own organic maintenance when the 
equipment was initially introduced. 

B. RIW DEFINITION 

A Reliability Improvement Warranty (RIW) is a fixed 
price commitment that obligates the contractor to repair 
or replace, within a specified time, all warranted equipment 
that fails during the period of coverage. Ideally, RIW 
motivates the contractor to increase reliability in order 
to decrease his repair warranty costs and maximize his 
profits. In a pure RIW contract the contractor is not 
obligated to provide equipment that demonstrates a specified 
Mean Time Between Failure (MTBF) . Instead the price of a 
warranty is calculated using an "expected" MTBF. If the 
field MTBF falls below this level the contractor will not 
realize a profit since the increased number of failures 
increase his repair costs. An increase in MTBF above the 
"expected" level will, in the same manner, decrease his 
repair costs and increase his profit. The contractor is 
therefore motivated to increase the MTBF of the equipment 
as much as possible if the realized savings from decreased 
repair costs are greater than the cost of improving the 
MTBF. 

A RIW may also be used in association with a MTBF 
guarantee as part of the warranty agreement. This arrangement 
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requires the contractor to guarantee that a stated MTBF 
will be experienced by the equipment in the field. Failure 
to meet this guarantee level requires the contractor to 
institute corrective action and provide additional spares 
to the government until the MTBF improves . 

In any case the RIW provisions should be established as 
a separate line item in the contract so that the cost of the 
warranty can be evaluated. In the case of RIW with a MTBF 
guarantee the additional cost of the MTBF guarantee option 
should also be established as a separate line item so that 
the additional protection of the guarantee also may be 
evaluated for cost effectiveness. 

Although RIW can be used to improve the reliability of 
equipment already in the field by applying the warranty to 
an equipment overhaul contract, the major benefits arise 
from using the concept in the initial production contract 
for new equipment. 

C. RIW AND THE SYSTEM LIFE CYCLE 

Although application of an RIW is associated with a 
production contract, it is important that the concept be 
considered early in an equipment's life cycle since a 
decision to use RIW will affect the configuration and design 
as well as the planning needed to obtain and support the 
warranted item. The interface of warranty activities with 
the acquisition cycle is shown in Figure 1. 
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During the conceptual stage studies are usually made 
that include the relationship of reliability, maintainability 
and expected life cycle cost. RIW as well as other methods 
should be considered as a means of achieving goals and con- 
trolling costs. In some cases a more traditional approach 
of specifying a design MTBF will be more appropriate. This 
is especially true for equipments that do not meet RIW 
application criteria (Table 1) . Another option is to com- 
pare Target Logistic Support cost with Measured Logistic 
Support Cost, a method that will be discussed in the F-16 
contract between the U.S. Air Force and General Dynamics. 

The Development Concept Paper^ (DCP) should include instruc- 
tions or requirements for the use of such control techniques. 
During the Validation Phase, consideration is given to 
required reliability levels and their impact on system 
support. Consideration should also be given to methods that 
can be used to achieve reliability levels. At this point, 
equipment candidates for RIW should be screened to determine 
if application criteria are met. Assuming the results of 
this initial screening are positive, an economic analysis 
should be carried out on each candidate to determine the 



The DCP is a coordinated, management document which 
serves as the vehicle for the Secretary of Defense's decision 
on major development programs; the record of primary program 
information, decision rationale, and decision review 
thresholds; and the instrument to effect implementation of 
these decisions. 
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TABLE 1 

RIW APPLICATION CRITERIA 

compiled from criteria stated by OSD(I&L), Army 
Material Command, and Naval Air Systems Command 

1. Warranty can be obtained at price commensurate with the 
contemplated value of the warranty work to be accomplished. 

2. Moderate to high initial support costs are involved. 

3. Unit is generally self contained, immune from induced 
failures from outside units, and has readily identifiable 
failure characteristics. 

4. Unit is readily transportable to permit return to vendor's 
plant or contractor can provide field service for it. 

5. Expected operating time and use environment known. 

6. Can be contracted for on a fixed price basis. 

7. Contract can be structured for a warranty period of 
several years so contractor has time to identify and 
analyze failures to permit reliability and maintainability 
improvements . 

8. Unit has potential for reliability growth and reduction 
in repair costs. 

9 . Potential contractors indicate cooperative attitude 
toward RIW acceptance and evaluation of effectiveness. 

10. Enough units are to be procured to make RIW cost effective. 

11. Unit is configured to discourage unauthorized field 
repair, preferably sealed and capable of containing 
elapsed time indicator. 

12. Reasonable assurance of high use of item. 

13. Unit permits contractor to effect no cost ECP's subsequent- 
to government approval. 

14. Failure data and operational use data can be furnished 
contractor cind updated periodically through life of warranty. 

15. Field reliability, costs to support, and reliability 
growth are reasonably predictable. 

16. Terms of RIW can be tailored so that risks and rewards 
to government and .industry are acceptable. 

17. Spare part requirements are difficult to predict. 

18. Cost of the RIW can be separately priced. 

19. Multiple-year procurement (competitive or sole source) 
is feasible. 

20. Unit is equipped with an elapsed time indicator; 
otherwise, the warranty must be based on calendar time, 
or some other means of determining usage. 
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economic feasibility of the warranty and the desired warranty 
period. Initial warranty provisions should then be deter- 
mined. In order to communicate to the contractor the inten- 
tion that a warranty provision is being considered, the 
Request for Proposal (RFP) for the Full-Scale Development 
Phase should contain a sample warranty provision intended 
for use in the production contract. The RFP should also ask 
respondents to discuss their understanding of the warranty 
provision and how they would operate under the warranty 
program. 

During the Development Phase, initial economic feasi- 
bility studies and warranty provisions should be updated 
to reflect program and equipment changes. At the end of 
this phase warranty provisions are incorporated into the 
production RFP. The warranty proposals provided by the 
responding contractors are then evaluated and a final deci- 
sion made regarding the intention to use RIW. If the deci- 
sion is made to apply RIW, the source selection activity, 
uses the contractor's warranty proposal information as an 
integral part of its evaluation criteria. 

During the Production Phase a plan to administer the 
warranty must be developed. The plan should include pro- 
visions for: 

« 

1. How the flow of the warranted equipment from the 
service's logistic management system will interface with 
the contractor. 
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2. User indoctrination for processing the warrantied 
equipment. 

3. Requirements for receiving inspection, and 
documentation at the contractor plant. 

4 . Requirements for the contractors and government data 
system. 

5. Offices responsible for the contract administration 
should be identified and be supplied proper data for 
administering the warranty. 

6. Methods for expeditious processing of Engineering 

2 

Change Proposals (ECP's) must be established. — 

7. If required, the contractor's repair and storage 
facilities should be reviewed. 

8 . Technical data review to insure that contractor 
has placed notice of the warranty and warranty procedures 
in the applicable technical publication. 

9. Review of Warranty Marking and Seals. 

During the Operational Phase the warranty should be 
monitored to insure that no problems develop in the overall 
logistic flow of the equipment. If problems develop. 



2 

An ECP is a proposal to make an alteration in the 
physical or functional characteristics of an item delivered, 
to be delivered, or under development, after establishment 
of such characteristics. 
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adjustments to the original warranty procedures may be 
required, however, if there is a change in the RIW contract 
it must be renegotiated and additional cost may be incurred. 
Before the end of the warranty period an evaluation should 
be conducted to determine if the warranty should be extended. 
The original terms and conditions of the RIW should be 
reviewed to determine if they are still applicable. A new 
warranty agreement must be negotiated with the contractor 
and a decision made to either extend the warranty or convert 
to organic maintenance. If a decision is made to convert 
to organic maintenance the conversion should be monitored 
to insure that test equipment, technical data/publications, 
spares, training, and maintenance facilities are provided 
to the government within the terms of the initial agreement. 

A RIW provision for an equipment overhaul contract must 
pass through most of the same procedures, however, since 
the equipment is already in the field these actions are taken 
during the operation phase (Figure 2) and do not have an 
effect on equipment design. 

D. POTENTIAL BENEFITS FROM RIW 

Potential benefits to both the government and the contrac- 
tor are anticipated from the use of RIW. 

1 . Benefits to the Government . 

a. Incentives and responsibility for field reliability 
are assigned to the contractor. 
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Figure 2. RIW Application to Equipment Already Deployed 



3 

b. Greater emphasis placed on Life Cycle Cost. 

c. Contractor is responsible for keeping all units 
up to the same configuration. 

d. There is an increased incentive for the contrac- 
tor to introduce design/production changes that will increase 
the MTBF of the equipment and result in reliability growth. 

e. An incentive for reduction in repair costs is 
provided, since any reduction in labor hours or material 
costs used in repairing the equipment will increase the 
contractor's profits. 

f. Minimal initial investment for support equipment 
is required by the government, since the contractor is to 
provide repair services during the warranty period. 

g. RIW usage may reduce requirements for skilled 
military maintenance and support manpower. 

2 . Benefits to the Contractor . 

a. Increased profit potential when MTBF is improved 
above pricing base. 

b. Multi-year guaranteed repair business during 
the warranty period. 

c. The contractor becomes more familiar with the 
operational reliability and maintainability of his equipment, 
which should help him in obtaining follow-on contracts . 



3 

The total cost to the government for the development, 
acquisition, operation and logistic support of a system 
over a defined life span. 
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E. CONTRACTOR RISK 



The major concern about the use of RIW has been the 
monetary risk to which a contractor may be exposed. The 
risk is caused by uncertainty in the field failure rate of 
the warranted equipment. The key element in the contrac- 
tor's pricing of a RIW is the predicted nTomber of returned 
items the contractor will have to process and repair during 
the warranty period. If the contractor's estimate of this 
rate of return is too low he can suffer a decrease in profits 
or even a monetary loss. Conversely, if his estimate is too 
high and he prices the RIW accordingly he stands to lose the 
contract to a lower bidder, or if he is awarded the contract 
will experience excess profits. New equipment, for which no 
field failure data is available, is the riskiest to warrant, 
while equipment which has been deployed and which has a 
known field failure rate provides the least risk. As men- 
tioned previously, however, the anticipated RIW benefits 
for the government are greater for new equipment than for 
equipment already in the field. The balance between risk 
and benefits can be partially maintained by the price of 
the RIW and various contract clauses or exclusions that 
attempt to lower uncertainty. 



21 



II. INTERRELATIONSHIPS OR RIW WITH FIELD RELIABILITY, 
CONTRACTOR RISK, AND GOVERNMENT COST 



A. RIW AND FIELD RELIABILITY 

RIW seeks to improve combat effectivenss by improving 
field reliability. One of the problems associated with 
this approach is defining field reliability in terms that 
can be measured. Historically, reliability values have 
been stated in terms of Mean Time Between Failure (MTBF) 
which describes the expected number of failures due to 
inherent system design. The design specifications for 
reliability normally include specific environmental condi- 
tions such as temperature, vibration and humidity. Unfor- 
tunately, the projected reliability performance based on 
these specifications has been much higher, often by a factor 
of ten or more, than the reliability experienced by the 
equipment in the field (Figure 3) . The reasons for this 
discrepancy are easy to identify but hard to correct. A 
large proportion of field failures are due to causes which 
are hard to define in specifications (Figure 4) . Even if 
all field failure causes could be identified and included 
in the reliability specifications, a demonstration test to 
show that these specifications had been met would have to 
be a full field test utilizing operational personnel and 
conducted in an operational environment. The time and money 
necessary to conduct this type of testing is not available. 
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^"Evaluation of Environmental Profiles for Reliability 
Demonstration," RADC-TR-75-242 , Rome Air Development Center, 
Griffiss Air Force Base, New York, September 1975. 
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Avionics Equipment Failure Causes 
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A. Dantowitz, G. Hirschberger , and D. Pravidlo, 
"Analysis of Aeronautical Equipment Environmental Failures," 
Technical Report AFFDL-TR-71-22 , Air Force Flight Dynamics 
Laboratory, Air Force Systems Command, Wright-Patterson Air 
Force Base, Ohio, May 1971. 
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RIW attempts to solve this problem by obligating the 
contractor to repair all equipment that is returned to him 
during the warranty period for a fixed price. Although 
certain failure classifications may be excluded, the effect 
of RIW is that the contractor must consider the field relia- 
bility of his equipment. In order to make a profit, the 
contractor must analyze these failures and improve the 
reliability of the equipment through ECPs. Extensive 
environmental, operational and field data is provided to 
the contractor to aid his effort. 

Since any corrective maintenance action in the field 
constitutes a field failure, fewer exclusions force the 
contractor to deal with a more realistic approximation of 
the actual field failure rate. Even with a large number 
of exclusions this rate is more reflective of the actual 
field failure rate than the old method of specifying inherent 
design MTBF since more failure categories are included. 

B. IMPACT OF RIW ON COMBAT EFFECTIVENESS 

Combat effectiveness can be defined as the product of 
three factors; performance of the system, the availability 
of the system, and the mission reliability of the system. 

RIW impacts on the latter two components (Figure 5) . 
Availability, which is a probability measure of the system 
being up when it is needed, is defined as the ratio of the 
equipments up time (reliability) and its down time (main- 
tainability) . Since the main objective of RIW is to increase 
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Effectiveness 



Performance x Availability x Reliability 



^ / 



RIW can impact these 
two components 



V’ailnbilit** - MTBF MTBF - Common Measure of 

^ MTBF+MTTR Reliability 






MTTR (Mean time to repair) 
Common Measure of 
Maintainability 


(1) 


Through incentive of RIW MTBF can 
be increased, the wider the warranty 
coverage (less exclusions) the 
closer MTBF approaches field 
MTBF 


(2) 


RIW 


indirectly decreases MTTR 




(a) 


Built in test equipment makes failure 
diagnosis easy. 




(b) 


Black box replacement makes field 
replacement easy 




(c) 


Fixed price incentive causes contractor 
to try to keep repairs simple and cheap 




(d) 


Specified turn around times keep supply 
delays down 



Reliability: Electronic components generally have 

constant failure rates. So 

^ ® ^ MTBF 

Mechanical systems, unfortunately, do not 
exhibit constant failure rates, however, 
their failure rates are often approximated 
by using a constant failure rate over a 
specified time interval. 

(1) Through incentive of RIW MTBF can be increased, 

the wider the warranty coverage (less exclusions) 
the closer MTBF approaches field MTBF. 



Figure 5. RIW Impact on Combat Effectiveness 
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reliability, availability is also increased. To a lesser 
extent RIW can lead to a decrease in down time, further 
improving availability. The mission reliability of the 
system is a measure of the probability that the system will 
remain up during the mission duration. Since this term is 
inversely proportional to the failure rate and RIW lowers 
the failure rate, this term is also increased. Clauses in 
new contracts frequently contain exclusions for damages to 
equipment caused by mishandling, improper installation, 
improper operation and unverified failures. The use of 
these and similar exclusion cause availability and relia- 
bility to be less reflective of actual operational values, 
therefore, the most effective warranty, from the government's 
viewpoint is one that has no exclusions. 

C. IMPACT ON DESIGN 

The maximxjm government benefits would come from applying 
RIW to procurement of new equipment because the contractor 
can then consider reliability in his design effort and make 
tradeoffs regarding production cost, reliability and repair 
costs where they will have their maximum effect. The equip- 
ment should, therefore have an initial failure rate that is 
lower than equipment procured under other methods. This 
failure rate will be further lowered during the warranty 
period. An RIW applied to an overhaul contract is less 
effective in this regard since the contractor is dealing 
with an existing design. Although he can make ECP's that 
improve reliability he can not alter the basic design of the 
equipment. 
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D. LIFE CYCLE COSTS 



A general equation for describing Life Cycle Cost is; 

LCC = Research & Development + Production + 

Cost Cost 

Operating + Support + Retirement 
Cost Cost Cost 

RIW alters the emphasis the contractor places on the first 
three terms on the right hand side of this equation. Under 
the traditional method of specifying a design MTBF the con- 
tractors main concern is to keep development and production 
costs as low as possible. Under RIW, however, the contractor 
is forced to consider his repair costs once the equipment 
is put in the field. This effects development costs 
indirectly. Development costs are effected since the con- 
tractor is given the incentive to consider reliability 
during the design stage. He will devote more effort in this 
direction which will result in added development cost. 
Production cost usually will be increased also as better 
quality material is used and the contractor uses better 
quality assurance and testing techniques. If the design 
effort leads the contractor to develop less complex equipment, 
however, his production cost could go down. The cost of the 
production contract, however, will be higher since the cost 
of the RIW clause will be added to the cost of producing 
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the equipment. Operating and support costs will be decreased 
since the price of the RIW includes repair costs for the 
warranty period. Post warranty operating and support costs 
should also be decreased since the RIW acts to increase 
reliability. 

The overall effect of a RIW contract should be to drive 
the total costs of the system toward the low point on the 
total cost curve (Figure 6) . Applying RIW to a contract 
does not guarantee reaching this point, however. The 
answer lies in performing an accurate economic analysis to 
determine the cost savings that are expected prior to appli- 
cation and choosing the least expensive alternative. If 
the RIW alternative is chosen another evaluation can be per- 
formed to determine the actual cost savings at the end of 
the warranty period. 

Although an RIW may not reduce system life cycle cost, 
it does have the benefit of providing more certainty con- 
cerning repair cost over the warranty period. This factor 
coupled with the increase in field reliability provided by 
RIW is a considerable benefit that is hard to measure in 
monetary terms but should also be considered in determining 
if a RIW should be used. 

E. INDUSTRY CONCERNS 

The Council of Defense and Space Industry Association 
(CODSIA) has been the primary spokesman for expressing 
industry concerns over use of RIW. The primary concern 
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Life Cycle Costs 



= Developnent + 
Costs 



Production 

Costs 



Operating 

Support 

Costs 



System 

Petirsnent 

Costs 



(As a rule of thumb; [Operating and £ 5 [Development and ) 

Support Costs ] Production Costs] 



RIW CAN INCREASE: 

Development Costs - indirectly by causing contractor 

to devote more effort to reliability 

# 

Production Costs - indirectly by causing contractor to use 

better material, having better Q.A. , 
better testing 

- directly by adding cost of RIW to 
production contract 



RIW CAN DECREASE; 

Operating + Support Costs - directly by increasing MTBF 

thus reducing maintenance, logistics. 




Figure 6. RIW Impact on Life Cycle Costs 



expressed by this group revolves around the monetary risk 
the contractor is exposed to when an RIW is used. The 
risk is greatest when RIW is applied to the first production 
contract of new "state of the art" equipment since no actual 
field failure data is available and the uncertainty in 
predicting the expected field failure rate is high. Con- 
versely this is the type of equipment where the government 
expects to gain the most from RIW application (Figure 7) . 

The uncertainty in predicting the field failure rate is 
increased by the "broadness of the warranty" since failures 
due to other than inherent design defects become increasingly 
difficult to predict. Industry, therefore, would prefer 
RIW warranties with a large number of exclusions. The 
government, on the other hand, prefers a broad warranty 
since it has a greater impact on field reliability and is 
easier to administer. The opposite positions of the govern- 
ment and industry are depicted in Figure 8. 

If new equipment were to be covered by RIW, CODSIA has 
proposed the use of a cost plus incentive fee type contract 
to cover initial production. The incentive fee would be 
based on meeting a target MTBF. A fixed price RIW would 
then be applied to the equipment after field failure rate 
data becomes available. Industry also feels that RIW con- 
tracts provide harsh penalties if specified turnaround times 
are not met. These penalties usually obligate the contractor 
to assign extra spares to the government, at no additional 
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Figure 7 . Contractor Risk and Government 
Benefits for Differing Types of 
Equipment Covered by RIW 
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Figure 8. Contrast of Government Benefits - Contractor 
Risk with Differing Equipment Type and 
Contract Exclusions 
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cost, until the turnaround time improves or assess the 
contractor monetary penalty for each day late. The 
penalties are made even harsher by a RIW contract that 
includes a MTBF guarantee since if the MTBF values are not 
met, additional spares must be provided until the MTBF is 
improved. 

The government desires these features in a RIW contract 
since a short turnaround time decreases its need for spares. 
The inclusion of a MTBF guarantee in a RIW contract also 
affords added protection to the government. Specifically ^ 
it may force the contractor to make an ECP to meet the stated 
MTBF, whereas, under a straight RIW the contractor may choose 
not to make the change since it would be less expensive for 
him to continue making repairs. This is especially true 
near the end of a warranty period where an ECP is less cost 
effective for the contractor. The differing viewpoints of 
industry and the government are depicted in Table 2. 
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Table 2. Goveminent and Contractor Positions on RIW 



Government 



1. Maximum benefits vdien 
applied to new 
equipment 

2. Apply to first production 
contract 



3. Minimum exclusions - best 
warran-ty the broadest 
warranty 



4. Firm fixed price provides 
iTBX incentive 

5. Use MEBF guarantee if cost 
effective and appropriate 
with RIW as determined by 
an econcmic analysis of the 
cost of the M3BF guarantee 

6. Short TAT less e^qjensive 
since need to buy less 
spares 



Contractor 



1. Vfould prefer to apply to 
equipment already in field. 

2. Delay application until field 
data available (field test 
before warranl^) 

3. Specific exclusions for: 

(a) fire 

Od) explosion 

(c) sx±jmersion 

(d) flood 

(e) aircraft (vehicle crash) 

(f) enemy action 

(g) seal broken on unit vdiile 
outside contractor's control 

(h) external physical damage 
caused by accident or 
willful mistreatment 

(i) internal physical damage 
caused by accorpanying 
external damage due to 
mistreatment or tampering 
by non-contractor personnel 

(k) induced failxnres 

(l) consequential/incidental 
damages 

(m) unverified failures ("retest 
OK") 

(n) iitproper installation/ 
operation/maintenance 

(o) designed, developed or 
produced by others than 
warranter. 

4. Cost + incentive fee based cn 
meeting target MIBF. 

5. Never use RIW with MTBF 
guarantee 



6. Wants minimum penalties for 
exceeding turnaround time. 
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III. CONTRACT ANALYSIS 



RIW contracts listed in Tables 3 and 4 were evaluated 
in terms of the following categories; 

1. Nature of Equipment 

a. New state of art for a new purpose. 

b. State of art improvement over existing equipment. 

c. New military application of commercial "off 
the shelf equipment". 

d. Additional procurement of existing military 
equipment. 

e. Overhaul contract, applied to existing military 
equipment already in field. 

2. Exclusion clauses. 

3. Use of MTBF guaranties and penalties 

4 . Turnaround time and penalties 

5 . Price 

6. MTBF improvement realized. 

Additionally, the difference in price between sole source 
and competitive contacts was compared, the contracts were 
evaluated in terms of contractor risk and potential govern- 
ment benefit, the changes in RIW application since the 1974 
memorandum by DDR&E and OSD(I&L) were analyzed and the use of 
RIW by the three armed services was compared. Finally, the 
cost effectiveness of the only completed long term RIW con- 
tract, the first USN (ASD/LSI overhaul contract for the — 
AJB-3 gyro) , was evaluated. 
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Table 3. Long Term RIW Contracts (>4 years) 



Item 



Manufacturer Service Year 



Warranty 

Period 



CN494VAJB-3 I£I 



USN(ASO) 


1967-first 


5 yrs/1500 hrs 




contract 


per unit 




1973-second 


6 yrs/1.2 million 




contract 


total operating 
hours 



A24G-27 LSI USAF 1969 

Gyro 



5 yrs/3,000 hours 
per unit 



APN-194 Radar Honeywell USN(ASO) 1975- 2nd 5 years 

Altimeter contract 



F-14 Hydraxilic ABEX USN(ASO) 

Pump 



AN/AFNU8 Collins USAF 

Tacan 



AFN123VDR/HS 

F-16 ACF 
systans 



Bendix 



General 

Eynamics 



USA 



USAF 



1973 



6 yrs/387,000 
operating hours 



1975 



5 years 



1975 4 years 



1976-under 4 years/300,000 
negotiation operating hoiors 



Contract includes MEBF guarantee 

Contract has three options; RIW 

RIW with MTBF guarantee 
LSC 
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Table 4. Short Term Contracts with RIW Provisions 

(<26 months) 



Year 

Item Manufacturer Service Awarded 



APN 154 UTE USN 1972 

Padar Beacon 



APN 99V Northrop USN(NAVAIR) 1973 

n Receiver 



AALJ-32A Kolsman USN(NAVAIR) prior to 

Barcmetric 1974 

Altimeter 



APN-194 Honeywell USN(NAVAIR) 1972 

Radalt 



INS Carousel Delco USAF 1972 



( 1 ) 



Contains MTBF guarantee 



Warranty 

Period 

26 months/1000 
operating hours 

2 years 
2 years 

2 years/1500 
operating ho\rrs 

1 year 
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The contracts were separated into two groups, long terra 
(over 4 years) and short terra (under 26 raonths) for purposes 
of the evaluation since the shorter terra contracts do not 
represent full potential of RIW. These contracts are 
included in the study, however, since they do represent 
application of RIW. 

A. CONTRACTS 

CN494A/AJB-3 Gyro, Contract between Naval Aviation 

Supply Office and Lear Siegler (LSI) 

This was the first military use of RIW and represents 
the only completed RIW contract for which a large data base 
exists. The contract, signed in 1967, covered the repair of 
800 gyros for a five year period. The gyros had been in 
field use for a number of years and were being repaired 
commercially by LSI and General Electric so actual field 
failure and cost to repair data could be calculated. Addi- 
tionally, the 800 gyros placed under warranty represented 
only about one third of the total gyro population so a 
direct comparison could be made between warranted and 
unwarranted units. Possible savings to the Navy were based 
upon the achievement of 1.2 million operating hours or 
1500 hr s/unit during the five year period. The initial MTBF 
was calculated to be 400 hours and the target MTBF was set 
at 520 hours. The total cost of the RIW was estimated to 
be $3,444 million based upon the induction of 800 "new" 
gyros at a cost of $4305 per unit. A savings of $686,000, 
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or 57<? per operating hour was projected. This contract was 
completed in 1973 and a follow-on contract with LSI negotiated 
for the original 800 gyros. The follow-on contract has four 
major differences. The contract price is lower ($2.5 
million, vice $3.44 million), operating time of 1.2 million 
hours is based on the total units covered and not limited to 
1500 hours per unit, the calendar time period has been ex- 
tended to six years, and the Navy has the option of including 
additional gyros under the contract if it is seen that utili- 
zation will not meet the anticipated 1.2 million operating 
hours over the six year period [Ref. 26] . The cost of the 
second contract is lower due to the reduction in repair time 
which resulted from reliability improvements made to the 
gyros during the first contract. The cost of the first 
contract was based on an average repair time of 75 hours 
per gyro. The cost of the second contract was negotiated 
with a repair time of only 45 hours. 

A24G-27 Gyro, Contract between USAF and LSI 

In 1969 the Air Force signed a RIW contract with LSI 
for maintenance of 128 gyros used in the Fill aircraft. 

The contract is for a 5 year or 3,000 operating hours per 
unit period and was the result of a competitive procurement 
between LSI and General Electric. This contract represented 
an additional procurement of gyros that were already in 
field use. The cost effectiveness of the contract would 
therefore be directly evaluated against non-warranted units. 
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The unit production cost of the gyro was $6040 and the 
warranty cost is $2200 which represents a repair cost of 
7.3% of unit price per year [Ref. 15]. 

F-14 Engine Driven Hydraulic Pump» Contract between 

USN (ASO) and Abex Corporation 

This six year/387,000 operating hour contract was 
negotiated in 1973 and covered 258 units at a cost of 
$1016 per unit per year. It was significant for several 
reasons. Although ABEX had considerable field experiences 
with hydraulic pxmps this pump was larger and represented 
a new state of the art design. .The contract is the broadest 
warranty under RIW to date in that ABEX agreed to repair 
all pumps returned to them with no exclusions. It incor- 
porated a pool arrangement in which the contractor kept a 
supply of ready to issue pumps on hand in order to meet a 
24 hour turnaround time from notification of a failure until 
a replacement pump was sent from the factory. The contract 
price was based on an expected MTBF of 500 hours during the 
first year growing to 750 hours in the last year [Ref. 25] . 

APN 194 Radar Altimeter, Contract between USN and 

Honeywell Corporation 

The initial procurement contract awarded to Honeywell 
for the APN-194 contained an RIW clause. The period of 
coverage under this contract was for two years or 1500 hours 
per unit and the cost of the warranty has been estimated to 
be about 7% of the purchase price. The APN-194 was a new 
radar altimeter intended to replace the APN-141 which was 
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experiencing a 50 hour MTBF. Although this contract had an 
RIW clause it was basically a maintenance service contract 
since it covered a short time period (2 years) and the cost 
of ECP's was jointly shared by Honeywell and the Navy. 

ASO has recently negotiated with Honeywell to provide 
a long term (5 year) RIW contract for the APN-194. The 
current MTBF of the unit is estimated to be about 465 hours. 
Under the RIW this MTBF is projected to grow to over 1040 
hours at the end of the five year period [Ref. 26]. 

AN/ARN-118 Tacan, Contract between USAF and Rockwell 

Collins Radio 

This contract was signed in July 1975 and was the out- 
come of a design to cost competition between Collins and 
General Dynamics/Electronics. The winning Collins bid was 
$9,400 per tacan, with an additional $500 per year per set 
for a period of five years under RIW. The initial contract 
calls for the coverage of 1000 units, with additional 
multi year options of 7,300 units. The tacan is a state - 
of art improvement over existing tacan sets . The RIW — 
agreement contains a MTBF guarantee of 500 hours for the 
first twelve months, 625 hours for months 13-24 and 800 
hours for months 25-48. If the field MTBF falls below these 
levels Collins is required to supply additional spares to 
the Air Force with no charge as well as making design 
changes to increase reliability [Ref. 8]. 
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AN/ARN 123 VOR - Contract between USA and Bendix 



Bendix won this competitive procurement for 1/139 VOR 
sets over four other bidders and signed the contract in 
1975. The contract covers a four year period and like the 
Air Force tacan contract includes a MTBF guarantee. The 
VOR set is required to demonstrate a field MTBF of 500 hours 
for the first year, rising to 600 hours during the second 
year and 700 hours for the third year. If these values are 
not met Bendix must determine the cause, take corrective 
action, and conduct additional environmental testing at 
no charge [Ref. 16]. The ARN 123 is a standard commercial 
unit that has been in use in the civilian environment for 
several years, however, this is the first military applica- 
tion. Even with the MTBF guarantee the unit per year cost 
of the RIW is only 2.7% of the purchase price, the lowest 
percentage price for any military RIW agreement. This low 
figure is representative of the high confidence Bendix has 
in the unit which has exhibited a MTBF of greater than 1000 
hours in the civilian environment [Ref. 22]. 

F-16 Components, Contract between USAF and General Dynamics 

The most ambitious RIW proposal to data is currently 
under negotiation. The contract could call for RIW coverage 
for up to twelve critical subsystems which have been defined 
as contol first line units (FLUs) . The contract could apply 
any of three different concepts. RIW with a provision for 
turnaround time, RIW with a MTBF guarantee, and a comparison 
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between Target Logistic Cost and measured Logistic Support 
Cost. Under the latter concept the actual logistic support 
cost will be computed based on data accumulated during a 
verification test of 3500 flight hours. The test will 
commence six months after the first F-16 squadron becomes 
operational. If the measured value does not exceed the target 
value, the contractor is eligible for an award fee. If the 
total measured value exceeds the total target value by greater 
than 25% the contractor must initiate a correction of 
deficiencies (COD) . 

Under the RIW option, the warranty period is 48 months 
or 300,000 flight hours, whichever comes first and the Air 
Force reserves the option to extend the contract in incre- 
ments of 24 months or equivalent flying hours. The contract 
specifies a maximum of twenty two days between contractor 
receipt of a failed FLU and placement of the repaired item 
in a secure storage area. The contractor must provide 
extra spares if the turnaround time is exceeded. 

The RIW with a MTBF guarantee option provides for four 
penalties if the computed MTBF for a given measurement period 
is less than the guarantee value for that period. The 
contractor is obligated to: 

1. Perform engineering analysis to identify the cause 
of noncompliance. 

2. Initiate corrective ECPs. 

3. Modify existing units in accordance with approved 
changes . 
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4. Provide additional spares on a loan basis until 
guaranteed MTBF's are met. 

Both RIW options are under Separate Firmed' Fixed Price 
proposals while the LSC option is on a Cost Plus Incentive 
fee basis [Ref. 24]. 

B. SHORT TERM CONTRACTS 

Several other contracts have included RIW provisions 
(Table 4 ) , however, these are basically maintenance service 
type contracts for short time periods (26 months or less) . 
The short time period of these contracts does not provide 
any incentive for the contractor to initiate any but the 
least expensive ECP's since the number of repairs he would 
reduce by initiating an ECP would not offset the cost of 
the ECP. These contracts, therefore, do not have an incen- 
tive for the contractor to improve reliability during the 
warranty period and are not RIW's in the strict sense. 

They do offer insurance to the government, however, in that 
the contractor would lose money on the cost of repairs if 
the number of actual repairs exceeded the number that was 
used in pricing the warranty agreement. The contractor 
therefore has a strong incentive to provide equipment that 
has an initially high reliability. Another advantage to 
the government is knowing that repair costs for the 
warranty period are fixed. 
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C. TYPES OF EQUIPMENT WARRANTED 

Of the eight long term (greater than 4 years) RIW con- 
tracts now in force or under negotiation three are overhaul 
contracts, one is an additional procurement of existing 
military equipment, one is a new military application of 
commercial equipment, two are applied to equipment that is 
a state of the art improvement over existing equipment, and 
one (F-16) covers units ranging from new procurements of 
existing equipment to state of the art equipment improvements 
(Table 5) . Of the five short term contracts, three were for 
additional procurements of existing equipment, one for an 
equipment that was a state of the art improvement over 
existing equipment, and one a new military application of 
commercial equipment. 

When the contracts are identified by the military service 
(Table 6) , it is clear that the Navy has applied RIW pri- 
marily to overhaul contracts for long term RIW, while the 
Air Force has used the concept for production contracts. 

The Navy procurement contracts that have used RIW are pri- 
marily for a short term period (<26 months) , except for the 
ABEX contract, and are basically maintenance service con- 
tracts. The lone Army application was a procurement of an 
"off the shelf" commercial item. 

D. EXCLUSION CLAUSES 

The basic exclusion clause in most RIW contracts to 
date has included exclusions for: 
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Table 5. Types of Equiptient Warranted 





Long Term (>4 years) 
RIW Contracts 


Short Term (<26 months) 
Contracrts Containing 
RIW Provisions 


New "state of art" 
for new use 


- 


- 


State of Art 
Inprovement 
over Similar 
Equipment 


F-14 I^draulic Pump 

AN/AFN 118 Tacan 
F-16 Ccmpcnents 


APN-194 Radar Altimeter 
(1st contract) 


New application 
of "off the shelf" 
conmercial 
equipment 


M^/AEN 123 VDR 
F-16 Ccmpcnents 


INS Carousel IV 


New Procurement 
for Netf Use of 
Equipment 
Already In Field 


A24G-27 Qtco 
F- 16 Coiponents 


APN 154 Radar Beacon 

AAU-3A Baranetric 
Altimeter 

ARN99V Cmega Rec:eiver 


Overhaul Contract 
No New Procurement 


CN494A/AJB-3 &/ro 
(two contracts) 


- 




APN-194 Padar Altimeter 
(2nd Contracrt:) 
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Table 6. Service Use of Warranties 



long Term (>4 years) Short Term (<26 monts) 

RIW Contracts Contracts Containing 

RIW Provisions 





USN USAF 


USA 


USN USAF USA 


New "state of 
art" for new 
use 


- 


- 


- 


"State of Art" 
Inprovement 
over similar 
equipment 


F-14 AN/AEN 

Hydraulic 118 
Pump Tacan 

F-16 

Ccmponents 


APN-194 - 

Radair 
Altimeter 
(1st 

contract) 


New 

application 
of "off the 
shelf" 
ccnmercial 
equipment 


F-16 

corpon- 

ents 


AN/ARN 
123 VOR 


- INS - 

Carousel 
IV 


New 

Procuranent 
for new use 
of equipment 
alreacfy in 
field 


A24G-27 

Gyro 

F-16 

Ccmponents 


APN 154 - 

Radar 
Beacon 

AAU-3A 

Baronetric 

Altimeter 








AFN99V 

Omega 

Receiver 


Overhaul 
contract 
No New 
Procure- 
ment 


CN494A/ 
AJB-3 
Gyro (two 
contracts) 

APN-194 

Radar 

Altimeter 

(2nd 

contract) 
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improper 



1. fire 

2. explosion 

3. submersion 

4 . crash 

5. enemy action 

6. damage caused by mishandling, 
installation, improper operation, and accident 

7. broken seal on unit. 

The lone exception to these types of exclusions is the 
contract covering the ABEX hydraulic pximp for the F-14 
aircraft which contains the clause; 

"In the event a warranted unit is lost or 
destroyed, an additional government owned unit 
will be introduced into the warranty population 
and will ass\ame the unexpired warranty of the 
unit lost or destroyed at no increase in contract 
price. If such replacement is not possible (e.g., 
because all existing units are covered by similar 
warranty) the U.S. Navy may elect to procure a 
replacement unit or the parties hereunder may 
negotiate an appropriate extension of the 
calendar limitations." [Ref. 14] 

The number of items that would normally fall under these 
exclusions, however, are limited and will generally not 
have a large impact on the number of returns the contractor 
must process and repair. 

A major item that can effect contractor costs under RIW 
is the return of units that "test good." A large number 
of these iinverified failures significantly raise costs to 
the contractor since he must test and process all units 
returned to him. If the contract contains an MTBF guarantee. 
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the contractor is also penalized if unverified failures are 
included in calculating the field MTBF of the equipment. 

RIW contracts, with the exception of those including a 
MTBF guarantee, have not included special provisions for 
unverified failures. The number of unverified failures for 
the equipment that have occurred in the past (if field 
data is available) or an estimate of the nxamber of unveri- 
fied failures is usually used in calculating the price of 
the RIW. The government indirectly pays this price when 
it purchases the RIW. This provides the contractor the 
opportunity to increase his profit if he can lower the rate 
of unverified failure returns. Contracts containing a 
MTBF guarantee have excluded unverified failures from the 
MTBF calculation and have, in two of four cases, contained 
a provision to pay a fixed fee per unit if unverified 
failures exceeded a specified rate. The use of exclusions 
is summarized in Table 7. 

E. MTBF GUARANTEES AND PENALTIES 

Two RIW contracts containing MTBF guarantees have 
recently been signed. One by the Army for procurement of 
An/ARN-123 VOR navigational equipment and one by the Air 
Force for procurement of a new generation Tacan set. 
Additionally the proposed contract for the F-16 fighter has 
an MTBF guarantee option to cover up to 12 control FLU's. 

An earlier procurement of inertial navigational equipment 
by the Air Force also contained a MTBF guarantee. The 
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Table 7. Use of Exclusions 



Long 
term 
RIW 
>4 yrs 



Standard Exclusion 
and provision for q. 
unverified failures ^ 

AN/ATN-123 



AN/AFN-118 

Tacan(2) 



Standard No. 

Exclusion Exclusions 



AJB-3 (^rro Abex 

(both contracts) hydraulic 

puirp. 

APN-194 Radalt 
(second contract) 

A24G-27 Gyro 

(3) 

F-16 carponents ' 



Short 

term 

RIW 



APN-194 (1st con'^act) 
APN-154 Radar Beacon 
ARN 99V Receiver 



provision 
(<26 mos) 



AAU-32A Baralt 
INS Carousel (IV) 



( 1 ) 

( 2 ) 

(3) 



government will reimburse contractor $100 for every unverified 
failure over 30%. 

MTBF guarantee - unverified failures not covinted. 

MTBF guarantee option unverified failures not counted. 
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guaranteed MTBF values and associated penalties to be 
evoked if the specified values are not met are summarized 
in Table 8. The penalty clauses used are virtually identi- 
cal. They provide for identification of the cause of 
failures, corrective no cost ECP’s, and providing additional 
spares xintil stated MTBF’s are met. 

Under a straight RIW the contractor has the option of 
improving the reliability of the equipment or of repairing 
more units if the reliability is not improved. The latter 
choice may be more cost effective to him especially during 
the later stages of the warranty period. The MTBF guarantee 
removes this option by evoking a heavy penalty by use of 
the provision for providing additional spares at no cost 
to the government. From a contractor's standpoint, therefore, 
there is a high degree of monetary risk involved in a 
contract containing a MTBF guarantee than in a straight 
RIW for the same equipment. 

F. TURNAROUND TIME PROVISIONS 

Turnaround time is important to the government since 
it has a direct impact on the availability of the equipment 
in the fleet. If MTBF is constant and turnaround time 

increases, the field availability will decrease due to spares — 

/ 

not being in stock. Availability can be increased by an 
increase in the amount of spares available, however, this 
is achieved at the expense of buying additional spares. 
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Table 8. MTBF Guarantees and Penalties 



Item 



Guaranteed MTBF 
(hours) 



Penalty 



AN/APN-123 VDR 1st year - 500 
2nd year - 600 
3rd year - 700 

AN/APN-118 1-12 ironths - 500 

Tacan 13-24 months - 625 

25-48 months - 800 

RIW/MTBF Guarantee option 



Engineering analysis to determine 
cause, corrective BCP's, 
additional environmental testing 

Supply additional spares at no 
cost determine cause corrective 
ECP's 



F-16 Canponents 



Inertial 


1-12 


months 


- 


185 


Navigational 


13-24 


months 


- 


284 


Unit 


25-36 


months 


— 


300 


Fli^t 


1-12 


months 


- 


162 


Control 


13-24 


months 


- 


242 


Corputer 


25-48 


months 


- 


260 


Padar 


1-12 


months 


- 


155 


E/0 


13-24 


months 


- 


228 


Display 


25-48 


months 


— 


244 


HUD 


1-12 


months 


- 


170 


Display 


13-24 


months 


- 


212 




25-48 


months 


— 


224 


Digital 


1-12 


months 


- 


210 


Scan 


13-24 


months 


- 


330 


converter 


25-48 


months 


- 


350 


Fire 


1-12 


months 


- 


415 


Control 


13-24 


months 


- 


600 


Cotiputer 


25-48 


months 


— 


640 


HUD 


1-12 


months 


- 


325 


Electronics 


13-24 


months 


- 


470 




25-48 


months 


- 


500 


E/0 


1-12 


months 


- 


155 


Display 


13-24 


months 


- 


228 


Electronics 


25-48 


months 


- 


244 



Engineering analysis to determine 
causes, corrective ECP's, provide 
additional spares according to formula 



INS Carousel IV After 6 months - 1100 



Iirprove system until MTBF value 
net, provide additional spares 
at 1/2 cost 



The MTBF guarantee is met if field MTBF meets or exceeds specified 
MTBF for two consecutive 6 month periods but no earlier than the 
2-1/2 year point. 
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Specified contractor turnaround times and associated 
penalties are listed in Table 9. Turnaround times range 
from 24 hours for the F-14 hydraulic pump to a high of 60 
days for the ARN 99V Q Receiver. The extremely short 
turnaround time for the F-14 hydraulic pump is made possible 
by designating 25 of the 258 pumps procured as rotatable 
pool items that are kept "on the shelf" at the contractor's 
plant. Penalties associated with not meeting specified 
turnaround time fall into three categories; warranty exten- 
sion, monetary penalty, or provision of additional spares. 
The warranty extension is probably the least effective 
penalty and causes additional detailed bookkeeping, while 
the provision for additional spares is the most effective 
since this helps to offset the lowered field availability 
caused by the increased turnaround time. 

G. COST OF RIW 

The cost of a RIW is frequently stated as a percentage 
derived from dividing the yearly warranty cost per unit by 
the original unit procurement cost. This method does not 
take into account differences in the terms and conditions of 
the individual warranties, which can effect the cost of the 
RIW. It does, however, offer a simple method of comparing 
the cost of RIV7 contracts. It also presents a guideline 
evaluating the cost of similar warranty provisions and 
establishing a price range. The cost of each RIW contract 
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Table 9. Turnaround Time 





Iten 


TAT 


Penalty 




AIB-3 gyro 
(2 contracts) 


45-60 days 


— 




F-14 Hudraulic puirp 


24 hr. 


warranty extended 2 
days for each day 
over 72 hours 


Long 

term 


AN/ARN 123 VOR 


20 days 


$10 per day for each 
day over 20 


RIW 

contracts 
(>4 yrs) 


AN/ARN 118 Tacan 


20 days 


$25 per day for each 
day over 20 




A-24G-27 gyro 


45 days 


— 




APN-194 Rad AH 
(2nd contract) 


- 


— 




F-16 cdtponents 


22 days 


contractor provides 
additional spares 
at no cost if not met 




APN 194 Radalt 


45 days 


.5% of purchase price 
per day over 45 




INS CAROUSEL IV 


— 


— 


Short 

term 

RIW 

provisions 
(<26 mcnths) 


ARN 99V n Receiver 
AAU-32A Baralt 

ARN-154 Radar Beacon 


60 days 
45 days 

30 days 


.5% of purchase price 
per day over 45 

extension of warranty 



period if not met 
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should be determined by an extensive economic analysis which 
evaluates the potential savings to the government and also 
takes into account the potential for reliability improvement. 

Table 10 documents available RIW cost figures. From 
the data presented it appears that the cost of RIW has been 
decreasing with time, possibly because of more familiarity 
with the concept. It also appears as if the Navy has generally 
paid a higher percentage price for RIW than have the other 
services but this may be due to the reasons stated above. 

In general competitive contracts appear to have been 
less costly. Of the nine contracts for which data was ob- 
tained five have been or are competitive. The average per- 
centage cost for these contracts is about 6%. The cost of 
the four sole source contracts is ±iout 17%. The Navy has 
negotiated all four of the sole source contracts and one 
competitive contract. While all Air Force and Army contracts 
have been competitive. 

H. MTBF IMPROVEMENT 

All RIW contracts for which data is available have re- 
sulted in reliability growth or improvement over replaced 
systems, expressed as an increase of MTBF. The increases 
have ranged from 30% to almost 200%, Table 11. Under the 
long term RIW contracts the contractors have used no cost 
ECP's to effect the increase in reliability for the AJB-3 
gyro and the A24G-27 gyro. Although ABEX has originated 7 
no cost ECP's to the F-14 hydraulic pump, insufficient data 
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contract contains MTBF guarantee option 



Table 11. MTBF Improvement 



Item 



AJB-3 gyro 
(1st contract) 


MTBF improved from 400 hrs to 520 hrs 
no date 


AJB-3 gyro 
(2nd contract) 




APN-194 Radalt 
(1st contract) 


Replaced APN 141 which had MTBF of 
50 hrs. MTBF achieved 450 hour 


F-14 Hydraulic Pump 


7 no cost ECP's originated, not 
sufficient data for evaluation of 
reliability improvement 


A24G-27 gyro 


MTBF over 1200 hours for warranted 
gyro vice 749 hours for unwarranted 
unit 


INS Carousel IV 


MTBF commercial unit was 1100 hrs 
MTBF of USAF unit was 2208 hrs 


AN/ARN 123VOR 


No data yet, commercial unit has 
MTBF 1000 hrs. MTBF guarantee 
, value - 700 hrs 


AN/ARN 118 Tacan 


Replaces AN/ARN-21/52/65/72 with MTBF's 
hour 

MTBF guarantee value - 800 hrs 


APN 154 Radar Beacon 


MTBF improved from 534 hrs to 2025 hrs 


APN 194 Rad Alt 
(2nd contract) 


Honeywell proposes to increase 
MTBF from 480 - 1110 hrs 
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is available to determine reliability improvement. The 
dramatic increases in the MTBF's of the INS Carousel IV 
and the APN 154 Radar Beacon, both short term contracts, 
were the result of changes incorporated in the production 
of the units rather than any changes made in the xinits 
after they were deployed. 

I. RELATIONSHIP BETWEEN CONTRACTOR RISK AND RIW PRICE 

If new equipment, with no field failure data, provides 
the greatest monetary risk for the contractor, this risk 
should be reflected in the RIW price and in the contract 
exclusions. Data for the eight long term RIW contracts does 
not substantiate this assumption. The two most expensive 
(calculated on a percentage basis) RIW contracts have been 
for overhaul contracts where extensive field failure and 
repair cost data was available. The broadest warranty to 
date, for the F-14 hydraulic pump had a high percentage 
cost but also had the shortest turnaround period. The use 
of a MTBF guarantee in the AN/ARN 118 Tacan and AN/ARN 123 
VOR contracts did not appear to raise the cost of these 
warranties to a high level. The F-16 proposal shows that 
using an MTBF guarantee would raise the price of the warranty 
by 12% to 93% depending on the component warranted which 
indicates that a MTBF guarantee is more costly than a 
straight RIW. Warranty contracts for the "riskier" equipment 
also contain more penalty provisions with regard to 
turnaround time (Table 12) . 
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Table 12, Contractor Risk; Long 'iferm Kiw uontxacT:s 
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(2nd con- 




i 



Although pricing data concerning the short term RIW 
contracts (Table 13) is lacking, there seem to be no par- 
ticular differences in exclusions or penalties between the 
"high" and "low" risk equipment. 

J. COMPETITION 

RIW contracts that have been competitive have been 
negotiated for a lower percentage cost than those that have 
been the result of a sole source negotiation. Of the nine 
contracts for which data was obtained four have been sole 
source and five have been competitive. The average percen- 
tage price of a sole source contract has been over 17% 
while the average percentage price of a competitive contract 
has been 5.8%, Table 14. The Navy has been the only service 
to apply sole source RIW contracts , it has also payed a 
higher percentage cost for warranties. 

K. TRENDS IN RIW CONTRACTING 

The DDR&E and OSD(I&L) memo of August 1974 establishing 
guidelines for RIW seems to have stimulated the use of RIW 
(Table 15) . All RIW contracts since 1974 have been for long 
(4 years or greater) time periods. The Air Force, in par- 
ticular, has attempted to apply the technique to new procure' 
ments . The contracts for the ARN-118 Tacan and the proposed 
contract for F-16 components are applications which offer 
the maximum benefits to the government. The F-16 contract 
is the most significant potential application of RIW to 
date. The avionic subsystems covered by a RIW option 
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Table 13. Contractor Risk; Short Term RIW Contracts 



Risk Price 

High 7% 



Equipment 

APN-194 Radalt 
(1st contract) 



Turnaround Time, 
' Penalties 



45 day TAT with 
penalty 



8.3% 



INS Carousel ' MTBF guarantee 
IV with penalty 



7 



7 



Low 



APN 154 Radar 
Beacon 

AAU-3A Baralt 



ARN 99V n 
Receiver 



30 day TAT with 
penalty 

45 TAT with 
penalty 

6 0 day TAT 
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Table 14; Competitive - Sole Source 
Contracts by Service 



Long Term (>4 years) RIW Contracts 



Item % 


Price 


Type 


Service 


AJB-3 Gyro 
(1st contract) 


33% 


Sole Source 


USN 


AJB- 3 Gyro 
(2nd contract) 


16.7% 


Sole Source 


USN 


F-14 Hydraulic 
Pump 


16% 


Sole Source 


USN 


APN-194 Radar 
Altimeter 
(2nd contract) 


3% (est . ) 


Sole Source 


USN 


Average Sole Source 


17.2% 






A24G-27 Gyro 


7.3% 


Competitive 


USAF 


F-16 Components 


4-10% (RIW) 


Competitive 


USAF 


AN/ARN 118 Tacan 


4.8% 


Competitive 


USAF 


AN/ARN 123 VOR 


2.7% 


Competitive 


USA 


Average Competitive 


5.8% 
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Table 15. RIW Contracts by Year 



Year 


Item 


Warranty 

Period 


Type 

Contract 


Service 


1967 


AJB-3 Gyro 


5 yr 


overhaul 


USN 


1969 


A24G-27 C^rro 


5 yr 


New Procursnent 
existing equipment 


USAF 


1972 


APN 154 


26 roos. 


new procurement 
existing equipment 


USN 




APN 194 
Radalt 


2 yr 


new procurement 
state of art 
improvement 


USN 




INS Carousel 


1 yr 


new procurement 
cotmercial 
equipment 


USAF 


1973 


ARN 99V 
Receiver 


2 yr 


new procurement 
existing equipment 


USN 




F-14 hydraulic 
puitp 


6 yr 


new procurement 
state of art 
inprovement 


USN 




AJB-3 gyro 


6 yr 


overhaul 


USN 


1974 

(prior to) 


AAU-32A Baralt 


2 yr 


new procurement 
existing equipment 


USN 



•EOR&E & OSD(I&L) Memorandum on RIW- 



AN/ARN 118 

m (1) 

Tacan 


5 


yr 


new procurement 
state of art 


USAF 






inprovement 




ARN 123 VDR/ 


4 


yr 


new procurement 


USA 








coimercial equipment 


APN-194 Radalt 


5 


yr 


overhaul 


USN 


(2) 

F-16 components 


4 


yr 


new procurement 


USAF 


(proposed) 






mix of systems 





Includes MEBF guarantee 

{ 2 \ 

Includes RIW option and RIW/MTBF guarantee option 



64 



represent the major cost-maintenance items in the program. 
This is also the first attempt to warrant complete sub- 
systems as previous warranties have covered individual 
"black boxes" only. The Army’s first attempt at applying 
the RIW concept, the AN/ARN 123 VOR/ILS is a middle of the 
road approach. The Bendix VOR is a standard commercial 
item that has been widely used in civilian aviation and has 
demonstrated a MTBF in excess of 1000 hours in that environ- 
ment [Ref. 22]. Meeting the guaranteed MTBF value of 700 
hours after three years does not appear to present much 
risk to the contractor as represented by the low (2.7%) 
annual maintenance cost. The contract does provide insurance 
to the Army, however. Whether this is cost effective remains 
to be determined. Of the three services, the Navy seems to 
have taken the least risky approach to RIW contracting. 
Although the RIW for the F-14 hydraulic pump was an ambi- 
tious contract representing a state of art improvement over 
existing hydraulic pumps the majority of the Navy's long 
term RIW contracts have applied to the overhaul of existing 
equipment. Although the F-18 and LAMPS programs are con- 
sidering the use of RIW both proposals have left it to the 
contractor to determine RIW candidates [Ref. 22]. 

L. COST EFFECTIVENESS OF RIW 

To date only one completed RIW contract (the 1967 USN 
contract with LSI for maintenance of 800 gyroscopes) has 
provided comprehensive data concerning cost effectiveness. 
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During the initial economic analysis LSI projected a 
$780,000 cost savings for the Navy over the five year 
warranty period. This savings was based on reducing the 
maintenance cost of the warranted gyroscopes by 65<: an hour. 

A total of 1.2 million operating hours was predicted over the 
warranty period [Ref. 26]. The cost savings were to accrue due 
to a 30% increase in MTBF over the five year period. LSI 
calculated that the cost per operating hour under RIW would 
be $2.79 which amounted to a $3.35 million fixed cost for the 
contract. The operating cost for unwarranted gyroscopes 
was $3.44 per hour or $4.13 million. The difference between 
the two figures ($4.13 - $3.35 million) represented the 
potential savings to the Navy. The minimum cost of the 
contract, was based on inducting 800 new configuration 
gyroscopes. In actuality a mixture of old and new units 
were inducted raising the contract cost to $3,766 million. 

The contract, as mentioned previously, was at fixed 
cost and based on a total of 1.2 million operating hours. 

During the five year warranty period the Navy achieved 
only 85 percent of this operating hour total which had the 
effect of raising the operating cost per hour. Operating 
hours were less than projected due to a decrease in actual 
flight hours and a difference between the projected ground 
to air ratio (1.63) and the actual ratio experienced (1.47). 
Based on the reduced operating hour figure the Navy only 
broke even under this contract [Ref. 26]. A potentially 
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f 






fSi' 





large savings may accrue to the Navy in the future because 
of the increase in reliability of the warranted gyros . 
These savings will be in the form of reduced repair costs 
and a reduction in the number of space gyroscopes required 
to support the installed units, however, actual data to 
evaluate these savings is not available at this time. 
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IV. CONCLUSIONS 



Since the majority of long term RIW contracts have not 
completed their warranty periods, final evaluation data is 
lacking. Questions concerning cost savings to the government 
and profits to industry must wait for this data before they 
can be answered. Nevertheless, several conclusions can be 
drawn from the data that is available. RIW contracts have 
been used in the procurement of new equipment that has 
incorporated state of the art improvements over the old 
equipment that it was replacing as well as to overhaul 
contracts that have sought to improve the reliability of 
equipment already in the field. 

The DDR&E and OSD(I&L) memorandum of 1974 urging the 
trial use of RIW seems to have achieved this objective. 

The Air Force, in particular, has negotiated an ambitious 
warranty contract for the AN/ARN-118 Tacan and is attempting 
to apply RIW in the procurement of the F-16 fighter. The 
Army has recently entered into a long term RIW contract for 
the procurement of new navigation equipment. The Navy's 
recent contract for the APN-194 Radar Altimeter represents 
a more conservative contract, however, the Requests for 
Proposals for the F-18 fighter and the LAMP.'s contain RIW 
provisions. 

In all cases for which data is available the inclusion 
of a RIW provision in a contract has resulted in MTBF 
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improvement. The question of cost effectiveness, however, 
remains unanswered. The first Navy-LSI overhaul contract 
for the AJB-3 gyro resulted in a 30% increase in MTBF and a 
reduction in maintenance cost of 20% per unit. The Navy, 
however, did not realize the potential cost savings from the 
contract because of a decrease in operating hours which 
resulted in fewer failures and fewer repairs. Data from 
other contracts is lacking. 

Several short term, 26 month or less, contracts that 
contained RIW clauses , have resulted in large MTBF improve- 
ments. Since these contracts are basically maintenance 
service contracts in that the short term of the warranty 
does not make no cost ECP's cost effective for the contractor, 
the large improvement in MTBF came from improvements incor- 
porated in the equipment during design and production. The 
contractor was given the incentive to make these improvements 
since he could raise his profits by lowering the number of 
repairs he would make during the warranty period. By 
placing a larger emphasis on reliability and strictly en- 
forcing reliability design specifications the same results 
could be obtained without the use of a RIW provision. 

Such an approach might prove less cumbersome and be more 
cost effective. 

One major advantage of RIW is that it provides the 
contractor with timely and accurate data concerning the 
reliability of his equipment under field conditions. This 
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enables him to isolate the weak points in his equipment 
and correct them. This will also help him in any follow- 
on designs since he gets first hand experience with the 
operating environment. Another approach that provides this 
type of information is comparison of Target Logistic Support 
Cost to Measured Logistic Support Cost, one of the options 
in the F-16 contract. The total cost of this option is 
less than 50% the cost of the RIW option and less than 30% 
of the RIW with MTBF guarantee option. Although this option 
does not provide the contractor with an incentive to improve 
reliability over a long term period, it does provide for 
an incentive to keep logistic support costs low which 
translates to a high initial reliability. 

Since all RIW contracts are for a specified operating 
hour or calendar time period the maximxam cost savings to 
the government occur only when this operating time is 
achieved. An actual utilization rate below that projected 
will, at some point, make the RIW more expensive than 
organic maintenance. 

In using RIW, the reliability of the entire weapons 
system must therefore be considered. In some cases, par- 
ticularly with new weapons systems, it may be more advan- 
tageous to cover a wide variety of systems under RIW to 
insure an overall high reliability. An example of this 
type of application is the proposed F-16 application. 
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ASSISTANT SECRETARY OF DEFENSE 
WASHINGTON, D.C. 20301 




installations and logistics 



14 August 1974 



MEMORANDUM FOR The 
The 
The 
The 
The 
The 



Assistant Secretary of the Army (Installations 
and Logistics) 

Assistant Secretary of the Navy (Installations 
and Logistics) 

Assistant Secretary of the Air Force (Installations 
and Logistics) 

Assistant Secretary of the Army (Research and 
Development) 

Assistant Secretary of the Navy (R.esearch and 
Development) 

Assistant Secretary of the Air Force (R.esearch 
and Development) 



SUBJECT: Trial Use of Reliability Improvement Warranties in the 

Acquisition Process of Electronic Systems/Equipments - 
ACTION MEMORANDUM 

Reference: (a) ASD(I&L) Memo to Secretaries of the Military Departments 

dated 17 August 1973: Subject: Trial Use of Warranties, etc. 



As part of the Department of Defense *s efforts to reduce costs and improve 
operational reliability of electronic systems and equipments, reference (a) 
requested that a trial application of warranties (now called Reliability 
Improvement Warranties (RIW)) be utilized in the acquisition process to 
help determine the scope. and benefits that RIWs may have for the DoD. 

The objective of a RIW is to motivate and provide an incentive to contrac- 
tors to design and produce equipment which will have low failure rates and 
low repair costs during field/operational use. This rechnique attempts, 
through the use of contracting agreements (which extend for several years 
after Government acceptance of the equipment) to provide an incentive 
repair costs in order to maximize their profits. Thus, the intent of the 
RIW contracting technique is to realize improved operational reliability 
and maintainability of DoD systems and equipments for each additional 
dollar that the contractor uses. For these reasons, a RIW is not a main- 
tenance contract and therefore should not be used for this purpose. 
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As a result of reference (a), a Reliability Improvement Warr.anty Committee 
was established to prepare a definite OSD policy with regard to the 
application of RIWs in the procurement process. The committee member- 
ship includes representatives from the Office of the Assistant Secretary- 
of Defense (Installations and Logistics), the Office of the Director,- Defense 
Research and Engineering and the Military Departments. Valuable inputs 
have been provided by each committee member plus contributions by 
representatives from the Office of the Assistant Secretary of Defense 
(Comptroller) and the Office of the General Counsel. Mr, Donald F. 

Spencer from the Office of the Assistant Secretary of Defense (Installations 
and Logistics) has functioned as the Chairman of the Committee. The 
committee completed the RL'/ Guidel'nes on 12. July 1974. Included in 
the Guidelines arc a RI '.V u efhutioa and^scope, tne RIV7 appucation criteria, 
the special funding r equirjij_r^enis , the essential elefnents in a RIW contract 
clause, t he RIW evalualion__appr_oach, and'lhe potentiarbenefitV which. may 

result from the use of a RIW. Thus, Jthe Guidelines enclosed hereto^ 

are available for immediate use on a trial basis and should aid in determin- 
ing whether potential cconumic and reliability benefits do, in fact, result. 
Therefore, the Military Departments are now requested to undertake a 
tria^u_sc of RIV/s in <a number of electronic system/equipment programs. 
These prograiii.s should he identified and their planned intended use of a 
RIV/ reported to the Office of llie As.sistant Secretary of Defense fiicL) 

,WI (Attn: hlr. Donald x'. Spenc-:::-) which will continue to function as t.he 
OSD coordinator for RI’.V activity. 
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To realize the maximum potential from the use of RIWs, it is important 
not only to identify tlie good ri'.sults but also to identify the problem areas 
80 that the latter can be factored in and corrected in the Guidelines. 
Particular attention slm'-'d He given to the collection of data so that 
accurate evaluation can V;o ensde of each program. It is requested that 
quarterly statu.s reporti bu submitted on the candidate systems. 
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LI ABILIT Y JM I^R OVLXl LWT V.-ABRa^^tY CUIDETTL’ES 



DEFINITION AND SCOPE 



One of the most significant items of continuing concern to the Department 

of Defense is the need for improved reliability and maintainability!/ 
v/eapon systems' equipment. 

A contractual technique used in the commercial environment and currently 

being utilized on a trial basis within the DoD as a means of implementing 

such improvements ■ is the Reliability Improvement Warranty, or RIV/ (also 

previously \incwn as a **Failure Free*’ or **StaJidar d Warranty). The 

objective of a RIV/ is to motivate and provide an incentive to contractors to 

design and produce equipment wliich will have a low failure rate as well as 

low repair costs, after failure due to field/opcrational use. Furthermore, 

tins technique attempts, t.hrough tiie use ox contractual agreements (where Ihl 

period of '>crformanco extends over several years), to provide an incentive 

% 

for contractors to improve the reliability of their equipment and to reduce 
repair costs during the period of warranty coverage in order to nta::irnize 
their profits. 

It sliould be noted that a RIV/ is not a maintenance contract and docs not 
require that the contractor provide routine periodic upkeep, regulations, 
adjusting, cleaning or ether noriT-al upkeep. A RIW also docs not cover 

* :x ? 



1^/ ain ta inabil iry '* refers to a design feature of a systcin,’ subsystem, 
cquipnicnt or corn.pc»ncnl whic)^ corjncVcc.s liiat the item is sub’L-ct lu 
beijjg repaired and rna'.nt ai:!.:d ir* an ostaV.d i s!icd envir ur.inc.i t , under 
defined c': r ’.in y c c . arc! wil’r.in lime end co.-.t rvi * r ai:.' ^ 

n*jed«.(! tv'. : c .~i ;:b) i e !'.ed )• i; 1 : ai.> il i ty r tcj s , ''M i m a i : b i.‘ ! ‘ 

?'.*i <!. ri*u- n: -.iidc*-;) :.i*ic «: repairs, bt:l rat!*it.*r, t!'.v ' vi:!* 

. t V i 4 I . » • . ^ 1 ' *' e * . v' V W I . t p ' I . . . . 1 . d , 
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components of a war r anted ilcni wliicli are expected to need replacement 
under normal use during the term of the warranty (such as filters, light 
bulbs, etc). Such items may be provided for by separate provisions in 
the contract consistent witli current laws and regulations, but they shall 

not be included in the PIV/ provision. In general, a RIW will provide for 

■ 

the repair or replacement of failed units as well as agreed to no cost 

engineering changes and the calibration, adjustment and testing associated 
0 

tiler ewith. 

The Armed Services Procurement Regulation (ASPR) slates that a 

v/cirranty c'lausc gives the GevernmerJ a contractual right to assert 

claims regarding the deficiency of supplies or services furnished, not- 

witlis landing any other contractual provisions pertaining to acceptance by 

the Government, Sucli a clause allows the Government additional tiiric after 

a.cceptancc of these supplies or services in wliich to assert a right to 

correction of the deficiencies or defects, re-perforrna:icc, an equitable- 

adjustment in the contract price, or other remedies. This additional 

period of tune may begin at the time of delivery, or at the occurrence of 

a specified event, and may run for a given number of days or months or 

until occurrence of another specified event. The intent of such a clause 

*/ ** 

is "buyer protection" fr om non- conforming materials or poor workniansiiip. 
The RlV/ goes bcyo.nd this conventional concept of warranty. - ‘ • 



t 



The essence of the RIV-’ philosophy is that during the period of the 

♦ 

warranty coverage, for a fixed price, contractors will be encouraged 
to improve the reliability and to reduce the repair costs of the equipment 
through the mechanism of "no-cost" (to the Government) Engineering Change 
Proposals (ECPs), These ECPs shall be consistent with Government 
procedures to preserve Configuration Control. Cnee a fixed price is 
established for the warranty, the actual profit realized by the contractor 
is dependent upon the equipment's reliability and maintainability in service 
use, plus auiy improvements that he can mal;e in its reliability and main- 
tainability so as to keep the number and cost of repairs as low as possible. 

A RIW results in the contractor focusing his attention on his reliability 
and maintainability efforts, since through such a program he car, obtain 
greater profit. Thus, a RIW becomes a contracting technique by which 
the Government derives the benefits of improved reliability a_nd main- 
tainability for each additional dollar that the contractor earns. The above 
features tlicrefore distinguish a RIW from the conventional warranties 
described in ASPR. 

The RIW concept may be introduced at any pc»int during the acquisition 
cycle. Normally, the maximum benefit can be expected by including such 
a RIW contract provision at the time of award of the initial production 
contract for tlic system/*.quipmvnt. For new equipment, it wUl ^generally 
be appropriate for the Cover nmv.nt to indicate to prospective contractors 
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early in the development cycle that it plans to consider such z v.arrar.ty 
provision for inclusion in the contract at the time of initial production ^ 

approval. , By so doing, contractors will be motivated to ensure that their 
equipment's reliability and maintainability are given appropriate attention 
at the time it is initially designed, since this could affect its subsequent 
•repair or replacement costs. 

The greatest value of a RIW contract provision is expected to be realized 
In the initial years of the equipment's field deployment. Thus, after the 
equipment's reliability and maintainability have been satisfactorily demonstrated 
through field use, the Government .may then assess the cost effectiveness of the 
RIW to determine whether to continue or to eliminate such warranty coverage. 

It should be emphasized that the terms and commitments required of the 
contractor, particularly for the initial warranty, should result in a reasonable 
balance between his risks and the degree of incentive needed to achieve the 
primary goal of system availability. The size and scope of the initial commitme 
should be determined in consideration of the uncertainities in future support 
costs and the risks involved to both contractor and government. This period 
of warranty coverage generally will continue for at least three years. 

RIILIAB ILITY IMPROVEMENT WAHR-AKTY (RIW) 

A Reliability Improvement Vrarranty is defined as a provision in either 
a fixed price acouisitinn, or fi\:*d p’'ico equipment overhaul contract in 
which: " 
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(a) the" conlr actor is provided with a monetary incentive, throughout 
the period of the warranty, to improve the production design and engineering 
of the equipment so as to cnliance the field/opcr ational reliability and main- 
tainability of the system/equipment; and 

(b) the contractor agrees that, during a specified or measured period 
of use, he will repair or replace (within a specified turnaround time) all 
equipment that fails. { subject to specified exclusions if applicable). 

A fixed price for the RIW coverage should be agreed upon during ncgotialio 
of the acquisition contract or cquipnicnt overhaul contract. The v/arranly 
should also be establisliccl as a separate conti acl line item. In the case 
of formally advertised contracts, the terms of the warranty and a separately 
priced contract line item must be ]3rovided for in the Invitation for Bids. 
RELIABILITY IMPROVEMENT V/ARRANTY (RIW) APPITC ATIOr-I CRITERIA 



Decisions for RIV/ appliciAion should be made as early as possible in the 
acquisition cycle. The contractor sliould be informed er.riy in the design 
pliasc that t.here will be warranty requirements .^o that he can ma.kc inrportanl 
trade-offs. It is noted that the equipment need not meet all the criteria shov.r 
below in order to apply a RIW. Rather, at this point in time the Coven. rvient 
should pick logical candidates which meet several cr ma.ny of the criteria 
so that further assessment can be made of the value of tliis technique. 

Tire followi.eg criteria may be used for .selecting equipment* as potcnticl 
candidates for P.cliability Improvement WruTanty coverage. Thc.se critori^i 
may be i;srd ;'oi- sy.stems, M.lisy stem.*;, u.nits, s*.; bun it s , or even n.oc? 

a. A v.<"'rrrnty ran b<- • btained ,nt a price r omnif-n >;-i r ate ’• "b-.' ct'O' ^ 

)>latcfl \’.'ilue of t:u; warranty x'.orV; to be arcumpj ic !ied . 
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b. Moderate to high initial support costs are involved. 

C. The equipment is readily transportable to p>ermit return to the 
vendor** plant or , alternatively, -the equipment is one for which a contractor 
can .provide for field service. 

d. The equipment is generally self-contained, is generally immune 
from failures induced by outside units, and has readily identifiable failure 
characteristics. 

e. The cq-ip;r.ent application in terms cf expected operating time and 
the use environment are known. 

f. The equipment is succcpliblc to being contracted for on a fixed 
price type basis. 

g. The contract can be structured to provide a warranty period of 
several years. This should allow the contractor sufficient time to identify 
and analyze failures in order to permit reliability and maintainability 
improvements . 

h. The equipment has a potential for both reliability growth, and 
reduction in repair costs. 

i. ‘Potential contractors indicate a cooperative attitude toward 
acceptance of a RltV provision and evaluation of its effectiveness. 

j. A sufficient quantity of tlic equipment is to be procured to make the 

ti 1 

RIW cost-effective. • 

k. The equipment is of a configuralion tliat discourages unauthorized . 
field repair, piff-r .ably scaled .and capable of eontainini; an -Elapsed 1 itij-. 
Indicator {ETi) some other mc.tn.? •'snp.e c ntrol. 

- -y 

r 
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l. There is a reasonable decree of assurance that there will be a 

^ I 

high utilization of the cejuipnient. 

m. The equipment is one that permits the contractor to effect no-cost 
ECPs subsequent to the Government's approval. 

n. Failure data and the intended operational use data can be furnished 
the contractor for the proposed contractual period and updated periodically 
during tlie term of the contract. 

FUNDI N G OF RELIABILITY IMPROVEMENT WARRANTI ES 
In the past, different points of view have been expi'essed regarding the 
funding of RlV/.s. Lack of clear guidance in this area has caused difficulties 
in the use of this contractual technique. In order to provide clarification 
regarding the types of funds to be used for pr ocur ements incorporating a RIV' 
the funding policy guidelines liavc been authorized for use by OASD 

(Comptroller) and Office of Assistiint Ge.ncral Cou.nsel(FAl). These funding 
guidelines should permit tlie*more effective utilization of RIlVs. 

a. RIV/s shall be funded from the same appr opr iatio.n as th.e acquisilio.-.- 
or overhaul warranted (i.c., the warranty sliall be paid from the procurement 
operatic:', and maintenance, or RDT<;E app’-opr iation of tlie service or agency 
concerned depending on from which of the said appropriations the acquirition 
or overhaul is funded). The RItV cost is part of the fixed price contract, and 
.payment to the warrantor foi ihe RIW poiMion sliall not be made in a manner • 
different than payment under the rcm.aini.ng portion of the co.a’tract, except 
that, payment for lh<' RIW' may be delayed until delivery or rclinejuisiin'.er.t of 
contio) of tiu: ilcm by tin wa r r an'.or . 
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b. In order to maintain the important distinction between a RIW and a 

< f 

service contract coverin” normal, periodic maintenance, the following 
requirements must be satisfied: 

(i) The RIV/ shall be inclu'ded in a fixed price contract for the 
acquisition or overhaul of an item or items. 

. (ii) The warranty period on each item shall begin after manufacture 
or overhaul, Upon delivery or r clinquishrnent of control of tlic item by the 
Nvarrantor. 

(iii) The RIW shall require the warrantor to repair or replace the 
W2-rrantcd item upon failure. 

(iv) The RIW shall not include requirements for the warraiitor to 
provide normal up!;ecp, cleaning, adjusting, regulating or ether periodic 
maintenance whicli would be required without respect to failure. 

(v) The RnV shall exclude compon«^nts of the v.*ar ranted item wiiich und 
normal circumstances will require i epl acement before the expiration of th.c 
warranty (sucli as filters, light bulbs, etc.). Such items Jiray be provided 
for by separate provisions in the contract consistent with current laws and 
regulations, but tlicy shall not be included in the RIW provision. 

ESSENTIAL ELEMENTS RIV/ CLAUSE 

Because RIW provisions must be tailored to the item selected, a standard 

RIW clause is not feasible. However, the following is a Hsi of lliosc essentia) 

: ; I 

clcn*icnts which normaJly should be considered for inclusion in such a.cjause: 



I. STATEMENT OF CONTRACT V/ARHAKTY 

•* . 

a. TERM . State length of time warranty will be in effect. This should 
cover usage (operating hours)and/or calendar time (generally three years 
or longer). 

b. OBJECTIVE /SC OPE : State the primary objective of the warranty, 

i.e., to motivate the contractor to design and produce equipment which is more 
reliable and less costly to repair than at present. If there is to be a 
specified reliability requirement, this should be clearly set forth in the 
contr act. 

c. FA.TLUPv E: Stale what constitutes a failure which will require the 

contractor to repair or replace a failed item, at his option, at no change 
in contract price. 

d. EX C Ell SIGNS : State what conditions (e.g. items lost or damaged due 

to fire, explosion, etc.) and actions associated with repairs (e.g. packing 
shipping, etc.) arc specifically excluded under the warranty. 

SMIPPI .X G COSTS: State if contractor or Government pays for expen sc- 

of returning failed units to contractor. 

f, PRICE: Indicate a separate price for warranty' coverage cind for the 

basic unit procured in order to make it possible to determine the cost to 
the Government of the RlV/. . 

II. CONTRACTOR OBLIGATIOM ^ ^ 

a. W A R R A N T Y ,'\ I A R K P\ G S . Require contractor to cause prominent displ. 

of pcrlin.'t i.^formalior. on s''.rface c.f unit, slu-wing tliat item is v.a.rrantcd. 
warratUy period, .-.clifins to talu- if 'init fail.s (''U-ing warranty’ prr-'.i.d, etc. 
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b, • TURN ABOUND TIN^S; Si.ci.to turnaround time required by the contract 

and contractual adjustments or other considerations, as appropriate, to be ^ 

exacted if the contractor exceeds the number of days so specified. A contract 

♦ 

turnaround time should be defined as '^nit |s received by contractor for 

repair, to date unit is repaired and shipped by contractor to Government. 

c. RECORDS: Require contractor to maintain records by serial number 

for each unit under warranty and to make such records available to the Government 
upon request, 

lU. GOVERNMENT OBLIGATION : 

a, CONT AIN EPS : Indicate whether or not the Government will supply special 

containers for reshipment of units to and from their destinations for the life of 

the warranty. 

b. NO-COST MODIFIC ATIONS : State procedures for submittal of contractor 

Initiated no-cost ECPc designed to improve the unit's reliability /maintainability. i 

i 

The contractor should be advised that such ECPs will be subject to the Government' 
approval. 

IV. MISCELLANEOUS 

a. INSPECTION ; State the extent of both Government and contractor inspectio; 
to be required. 

b. DISPOSITION ; State tiial each unit returned, that is not considered repair- 
able, shall be disposed of by the contractor as directed by the Adniinistr ating 
Contracting Officer (ACO). Al-tio, indicate the manner of disposition of the unusc-d 

po-tion of the warranty for any •mil sebii-clt.d to an e.\cluc1c*d failureor t!ial, upon 
certificati-.jn by the .•\CO, ih. de< ].ir«c\ lo.-i. 

! 
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NOTir-'lC A'J'ION ': Indicate-, llic rcquircm .r.t for both the contractor and 

the Government to notify each other, within a specified time, of any deficiency 
discovered in a unit. 

d. . UNVEKIFIfID FAILURES : State whether or not the contractor will be 

compensated for the cost of testing items returned to him under the warranty 
lor which no discrepajicy is found. 

e. AD JUST M EN T S : Lidicate under what circumstances, if any, the Govern- 
ment is author i;'.cd to make adjustments to units under warranty. 

V . DATA 11 EQU I ’1 EM ENTS 

a. WAllKANTY DATA; The contractor will be required to establish and 

maintain a data system capable of ))roviding a repair record of each unit, 

✓ 

analysis of unit failure, number of itciris returned, turnaxou.nd ai.d jidpclinc 
time of unit rctur.ncd, remaining wairaaity coverage, etc. 

b. GOVERrvMENT DEVELOPED DATA. The Govcrnm.cnt shall be required 
to provide in a timely manner, available Governinent generated operation and 
maintcjia.ncc data generated on the equipment. 

DET E RMINATION OF COST EFFECTIV E>’ESS OF USE OF A RELl.ABJLITY 

IK-I PR OV EM ENT W .AR R A N T Y 

The benefits to be derived from use of a RIW provision sliould be related to 

/ 

the cost thereof to l!ie Government as well as system reliability and availability. 

In the case of new systems and equipment entering the Government inventory 
which arc- not similar to existing equipment, the Go\ crnnicnt will have no circ-ci 






< 



83 



1 



experience with such items for a baseline cost. Therefore, to compute benefits 
versus warraJity cost, in the above instance, may require judgment on the part 
of the Government. 

♦ 

In g.eneral, a cost analysis should be performed for each proposed warranty 
application, upo.n receipt of the contractor's proposal, in order to determine 
■whether or not use of a RIW would be cost effective. Such an analysis should 
investigate the relative cost of the RIV/ and non RIW situations (including ECPs) 
and examine the cost of varying time periods. The use of a RIW provisio.n will 
generally involve additional costs over the acquisition cost. These costs must 
be compared with "in house" Government costs to perform repairs and make 
equivalent reliability improvements. ; 

The decision to accept or reject a RIW provision must, therefore, be 
based in part on tlie support costs the Government would incur if the equipment 
were purchased without a RIW. The Government support organization would 
have to provide a cost estimate to do the things that tlie contractor would do 
under the RIW. 

In order to make an accept /reject decisio.n as to use of a RIW provision, 
tile actual price proposed by tii'- contrrictor for the RIV/ must be Imown, It is 
therefore important that the rootraclor be required to ^separately price the RIW 
provision sot hat a comparison can be made with the Government estimate. 



Rl iLIABJEITY i.\tPROVn MEN T WA R R.AXTY EVALUATION APPRDACH 

In evaluating Urn c-ffectiv(!!.ess of llie RIW approach from a cost and perform, 
viewpoint, it is ej'Sentiu] that .iccurale data be gathered on field reliability and 
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utilization plus maintenance actions and that the contractor be cooperative in 
reporting actions taken under llic warranty. Bolli the Government and the 
contractor *'aust csta.blish and maintain a data system capable of providing 
information relative to warranted equipment so that a suitable evaluation can be 
made. 

It would be most desirable to determine how effective the RIV/ approach 
has been when compared with identical or similar equipment whose repair 
was ^ccornplisheel by a Government repair facility or by separate contract; 
however ,* this may not be possible in many instances. Thus, wlicn an item 
under wcLrranty is being produced for the first lime or, wlicn there is no 
identical or similar non- warr aJited equipment available for comparison, it 
\Jil\ be necessary to compute what it would have cost the Government repair 
facility to do the job if tl^erc had been no warranty prevision In the contract, 
based on the failure rates actually cMperienccd, lime to repair, number of 
spares required, etc. Tins method of coniparing estimated Government repair 
facility costs witli the contract price paid for the warranty is one of the few 
methods available to evaluate the relative cost of tlie warranty approach wlicrc 
a control group is not present, , 

In assessing whctlicr or not the RIW ^^pproach used in a given procurement 
has increased reliability, ca'sc of maintenance, and the service life of the 
equipment from both an acquisition ^lnd a repair and overhaul basis, we must 

1 I ( 

ensure that sufficient usage data is available under the contract to enable a 
proper analysis to be ir.acle. In other words, a significant portion o^ the contract 
warraJity r.iu-^i cCimjjJ -tied , witJ'. respect to expended l;oars, so tl*/.t 
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trend has been established. This is especially important since t.here is 



a possibility that benefits commensurate ■with the price paid for the warranty 
may not materialise because of a'reduction in the use of the equipment under 
that contracted for in the warranty provisions. 

Factors to consider in evaluating RIW results (pertaining mainly , to equip- 



as follows: 

a. Number of operational units procured. 

b. Price of basic unit as well as price paid for warranty coverage. 

C. Warranty period in months. 

d. Operating hours used per month, as well as total program operating 
hours involved. 

e. The planning MTBF that the warranty was based upon, as well as the 
number of returns planned on during the warranty period. 

f. In the case of new equipment buys, the amount of savings estimated in 

initial Government support costs by precluding the need for such support items 

as test and support equipment, training of Governrnent personnel and technical 

m*amials. However, in determining the savings involved, care should be taker. 

that if the Government expects to assume support after the warranty expires, • 

:» ( 

"start up" costs should be >nclutled. ' * ' 

g. Government recurring support costs, such as the cost of warranty 
administration. P'nr example, tn? ui' ••nanj.c and supply pcrsohncl must be 



ment for which we have operational experience) in order to make a determinatio: 
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trained in handling and shipping warranted units so as not to void the 
terms of the warranty. Furthermore, the special data requirements 
of warranty clauses will also require adminis tr ative action. 

Number of spare units required due to excessive contractor turn- 
around time, and cost thereof to the Government. 

i. Comparison of cost of organic repair (processing through Government 
depot repair facility) of unwarranted items with repair costs for same 
items under warranty. 

j. Comparison between contract price for RIW coverage (for the hours of 
operation contracted for under the warranty provisions), with the repair 
expense based on acquiring the same number of operating iiours from an 
unwarranted unit. 

k. Comparison of MTBF, turnaround and pipeline tiimc of the warranted 
items v/itli tliat for unwarranted similar itenis and tlie effect thereof on 
availability of equipment to the Government. 

l. The extent to which any improvement in the X1TBF, turna.round and 
pipeline lime of the warranted equipment may be attributed to the RIW 
contract pro\'isioiis . 

m. If there is a reduction in the use of the equipment under that contractc.d 

/ 

for in tlie warranty provisions, whether or net this has resulted in benefits 
not being coninmns ur ate with t!ie price paid for warranty coveraj^e. 

n. Any reduction in cost associated with relaxation of configuration 
coiitrol, cj'.u'.l’ly assurance and^ rel iabil i* y Icsts. 

< 
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A principal motivation for PIW is to provide an incentive for the manu- 
facturer to be responsible for the field reliability (ratlicr than laboratory 
or bench reliability) of his equipment and encourage him to modify the 
equipment as needed to achieve reliability improvements. 

In the absence of such an incentive the government has traditionally 
relied on a number of specifications and standards for configuration 
management, quality assurance, reliability demonstration and parts 



and fabrication procedures in an attempt to enforce the production of 
reliable and maintainable cqui]:>mcnt . For eacli procurcmcjit for which 
a warranty is planned, a review should be made to insure thiat procedures 
and specifications are not applied in such a manner as to increase inherent 
costs or to reduce contractoi* oj.^por tuni tics to make cost savings. 
POTFNTIAJ. EENEFITS FFOM USE OF KELIABILjTY IMPiiOVEkt ZNl* 



V/ARFAN Tins 

Many potential benefits to both ihe Governnaent ana the ccntrr*ctor may 
result from the use of RIW provisions. Some of these benefits are as 
follows: 



BENEFITS TO GOVERN? ENT 

a. Incentives and resf>onsibi! ity for field reliability are assigned to the 

contractor . ' • . 

: 1 ! 

b. Greater emphasis is placed on the life cycle cost approoc!:, ' ' 

c. The contractor is responsible to keep all units up to the same 
c OP fig u]* a lion . 
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d. There is an increased incentive for tlic contractor to introduce 

« i 

• dcsipn/production change's that will increase the MTDF of the equipment 
and result in reliability growth. 

e. An incentive for reduction in repair costs is provided, since any 

reduction in labor Iiours or materials used in repairing equipment will 
increase the contractor's profits. , 

f. Minima) initial support investment is required by the Government, 
since the contractor is to provide repair services during the warranty 
period. 

g. TvlNV usage may reduce rcquircinents for skilled military maintenance 
and support manpower. 

' BENEFITS TO CONTRACTOR 

a. Increased profit potential when field MTBF is impro\cd above prici.ng 
base . 

b. Mull i- ye;tr guaranteed business. 

c. The contractor beconiec more familiar with the operational reliability 
and maintainability characteristics of liis equipment, which should help hini 
in obtaining follow-on contracts. 

CONCLUSION 

In conclusion,^ a Reliability Improvement Warranty is a nrocur e mor.t 

I 

approacli which, when properly applied, can reduce th.c- Cover nmc.nt' s life- 

Ti ( 

cycle costs. In'.jcrcnt in t.he RIW concept is the contractor's motivation to 
continuously reduce repair or replacement life cycle costs thro-.e^h r eli.";b;l i‘ .. 
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effort applied beyc)nd hardware acceptance. Due to the continuous stress 



by the c.ontj-actor on decreasing failur 

through better equipment a\'ailability . 

. I 

I 

1 

1 

I 

I 

I 
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rates, the Government benefits 
^ • 
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washingumV, n.c. v:rjoi 
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If/STAUATIOfJS Af.'f) LOG.’STi'S 



1 6 SEP 1975 



MEMORANDUM FOR Assistant SccretJirics of the Military Departments (Ri;D) 

Assistant Secretaries of the Militai'y Departments (IScL) 

SUBJECT: Reliability Improvement Warranty (RIW) Guidelines 

References: (a) ASD(Ic.cL) Memorandum to Secretaries of the Military 

Departments, dated 14 August 1974, regarding Reliability 
Improvement Warranty (REV) Guidelines. 

(b) CcunciTof Defense a.nd Space Industry Associations 
(CODSLA.) Ectter, dated IS July 1975, regarding RIW's. 

The purpose of this memoTandum is to clarify and expand, on DoD's current 
RFW Guidelines. Your support in cojitinuing to sec that reliability incen- 
tives are properly applied to contracts is 'essential to reduce support costs 
and improve field reliability. This is especially important in light of the 
recent concerns expressed by industry that RIV/'s may be inappropriate ly 
applied so as to pose undue risk on contractors (reference b, enclosure 2, 
the issues raised therein will be investigated by a recently formed 
tri-Ser\dce \/orking group). . • 

\ ' 

Wc wish^to rc-emphasizc that the principal objective in applying RIV/‘s is 
to incentivize contractors to design and produce reliable equipment. 

Imposition of unreasonable terms and risk on contractors will not serve * 
this objective. 

The RIW objectives can be best achieved under a fixed price contractual 
agreement. Other incentive approaclies for improving cqviipment reli- 
ability should 'be utilized when application of a RIVv'' would result in undue 
risk, A recently established “Tri-Service Reliability and Support Incen- 
tives Grouj)^ will in the next four inonths investigate other contract incen- 
tive techniques and develop guidelines for these concepts. Your support 
of this group’s efforts is requested. 
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Two major criteria for the appUcatiqn. oi P.IV/'s ar.; that: (1) ihe field 
reliability, costs to support the equipment, and pot :.ritf el foj* reliability 
growth will be reasonably predictable at the time Llie firm fi:‘rcd price 
bid is made,, and (2) the terms of tlie RiV/ be tailored so IIvlI tVic rewards 
and risks to both industry and the goverjiment am*. :i cce].)ta]^J i*. These 
criteria are discussed in enclosure 1. 

The above. criteria should be dissemincilcd as a da riCication a.nd expan- 
sion to the current RIW guidelines* Procuring agencies should be 
instructed to apply the two preceding crltcJ'la. Fc>r each RIW application 
an independent analysis should be performed to dcdernunc that contractor 
bids arc reasonable and that there is a proper baJance between potential 
rewards and risks. 

Proper application of the above guidelines will contribute to the wider 
use of warranties on a sound basis. 
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AIM M .JCATIO X' O)'' lUW • |- 

i 

M.\JOU CraTlilUA for application of llIW's arc; 

. ’ • 

1, I'ield r cli?.bility, costs to support the equipment, and potential 
for reliability growth will be reasonably predictable at the time the firi'.i 
fibred pj*icc bid is iriudc. 



2. Terms <Jl the .RIW be tailored so that the rewards, and risks to 
botli industry and the government are acceptable. 

For RIW application to iKive maximum affect, contractors sliould be: 
told early in de veJ opmeiit ihiil a warrojity is anticipated. It i.s desirable 
to elicit a warrai'ity quote during the competitive pliasc in order to get a 
reasonable price. This raise's the problem that the quote niay be solicited 
prior to the completion of development testing and with associated 
uncertainties . As a general rule, the price quote should be solicited as 
late in tlic program as possible, under competition, and consistcjit v/ilh 
the needs for test data associated with each program. 

There are a nunrber ‘of criteria which should be satisfied for a pro- 
gram to be selected for RIW^ appliceition, examples of which etre cor.air.cd 
in the current RIW guidelines. A major criteria which should be emphasized 
is rcasoJiablc risk to industry as well as to the government. Such is 
significantly influenced; (1) by whether the equipment is c volution.ary , (2) 
by the availability of test data (at the time of bid) on which to base cost 
and reliability estimates, and (3) by the ability of the government to 
provide thr contractors with reasonable projections of mission, cjiviron- 
ment, and expected utilization. 

Application of RIW's does not have to be limited to procurements that 
are merely a repackaging of previously fielded equipment. It car. be 
applied to any new equipment, even if tlic design utilizes new tcclmolcgy 
and there is lio previous field experience. W^hat is important is that 
adequate development time and testing be scheduled to support rca.sonabIc 
cost and reliability estimates at the time the firm fixed price bid is made. 

For any RIW application, considerable latitude exists in tailoring the 
terms and conditions to the uncertainties. For example, the reliability 
guarantee can be tailored; turn-around time requir emcnls can be v'a.ricd; 
exclusions can be adjusted to fit the situation; and tlic iiiitial commitment 
can be limited to tlic initial production buy. In general, the greater the 
uncertainties the less strijigcnt would be the warranty terms. In no case, 
however, should terms be tailored to such an extent that tlic RIW objective: 
of improved field reliability and reduced support co.sts arc no longer, 
inccntivdzcd. 
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TO 
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•‘RELIABILITY IMPROVEMENT WARRANTY - KEY ISSUES’* 
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I. timiik; ov kiw ai’imjcation: 



A. V/lic*n Shoultl RiV/ Re Applied? 

In dJdressinp, Llie question of "when" RIW should he applied, consideration 
must at the same time be j»ivcn to "how" It should be. applied, and also 
to pertinent background und historical factors relating to reliability, 
from the laboratory and field usage vantage points. Fundamentals of 
contractor and governnuint risk must also be addressed. 

o Backg round 

Industry is keenly av;are of, and quite sympathetic with, the USAF 
need for improved field reliability and feels that one route to the 
achievement of that goal may be a properly applied RIW program. The 
current change in emphasis from "performance at almost any cost" to 
a desire for a proper balance of performance, unit production cost, v 
reliability, maintainabi 1 L ly , and availability is also well recognized 
and applauded. In achieving this balanced emphasis on reliability and 
l(j\/er operating costs tlie IkSAF has felt the necessity to ])rovide an 
early incentive which will help .insure proper emphasis on lower oy)C*rat ing^ 
cost (i.e., reliability and ma intainabil ity) during the critical design / 
and development period. It is during this period that the greatest 
impact on eventual field reliability will he realiz(*d. The j^rol^lcm of 
high operating cost and associated low availability resulting from poc-r 
fie. Id reliabil it y and maintainability is not new. 

While it is true that performance has been the overriding factor 
in forr.jcr years, the relial)ility question was not entirely j[uiorcd. Tlie 
init ial ai)proach \.»as to spc‘cify a recjuiicd MTBF in the procnrf‘inen t sjiec' . 
Laboratory test s in a benign env i ronment v;ere carried out to demnnr>t e 
that the specified reliability had been achieved. Later an attempt was* 
made to simulate the ainbicait environment during these laboratory test^*>, ( 
and finally, reliability growth testing was instituted during the labora- 
tory reliability test cycle. That tliese technicjues did not acineve tlio 
desired resul.ts in the field is evidenced by the chart on page 10. This 
chart plots the reliability achieved in tlic field against the specified 
reliability for ten different tactical radars in as many varieties of 
aircraft. All of the various previously discussed technic]uc‘S for lug 

reliability in the laboratory are represented in tins sample. I^rcfunv''' 1 y , 
the laboratory tests appro>< i mated the specifications before commitmf*n. ts 
to full scale production v;cre made. Tt is, tlutreforc, obvious tliat tho5U' 
techniques did not solve tlie real problem of reliability in the field. 

There Is little doubt that the USAF faces a real prol^lem if a nieans 
of rc* versing tins trend of low field rc^liability and resultant high 
operating; and maiutonance cost is not found. According to lilg.hly 
qualified Do)) sources, fifteen years ago 50% of tlie USAF lnRl)»g*t was 
expended on investiiiOnl in new equipment and 50% on O&M and pay. Ted.'^y, 

30% is spent on investment and 70% on 0<^M and pay. Unless this tro”/ 
is rc-versed, the cons('.qiK-*ncos to the USAF, industry, and tl)o nat •>’11 
bo indeed serious. 

Tlie USAl* <lc‘siie to introduce the RIW concept quite early i: ’ 

devolopmonr cycle of a i'>r()gram and thereby provi<]c the incentivo ic w \atL 
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the contraci-or to cuiii^LJcr ficKl reliability on at least an equal 
footJn[* with unit production cost and pcrfonnnncc is quite under- 
standabie. CODSIA aj;ri‘es , and the potential differences of opinion 
relate only to the technical methods and contractual implementation 
by which this objective is to l^e accomplished, 

o Reasonable Pr ed ic t abiJ ity and Risk vs. Traditional Reliability 
Tost M('tln*ds 



Industry feels that the requirement for Firm Fixed Price (FFP) 

]\l\J quotations or optioiis on production articles prior to completion 
of tlie deve](q)ment cycle is an unsound procurement practice for both 
f;oveiumont *and industry. Until the hardware is tested in an opera- 
tional environment, with typical cipera tional users, and in all planned 
vcliic] e.s/pl a L forms , etc., reliability (the basis for a good RIW quote) 
is not "roa.snnabl.y prc:dlc. table'* . 

This if; especially true in today’s technological environment where 
very rapid cl»anges art! the order of the day. In the avionics arena 
for example, we have, in the last 15 years, progressed from largely 
therniJiunc drvLces to discrete solid state technology and on to inte- 
grated ('ircuitry. Integrated circuits themselves h«ave rapidly gone 
from ratiur simple deviees to medium scale integration, and on to 
large scale, iniegra t ioii . Meanwliile system concepts have eliangcd from 
uLilixinj; largely analog interfaces to today’s reliance on digital 
interfaces , 



All of tliis teclinological advancement appears to l)e moving in 
the rig,ht direction to greatly improve rel ial^ilil.y over that of earlier 
generation ecpi i ]'>men t and the reliability predictors are postulating 
tills to be 1 he case. Caution is urged, however, since in the past 
re.l i airi 1 i I y predictions liave seldom if ever matclicd ffic'ld reliability 
nuniber.s, even v/liere similar technology has been previously fielded. 

The accuracy of tlie predictions is even more qucstimabl e v.dien the 
tc*chnology involved has not had the l^enefit of a vaiLiid comparison 
betwe^en actual field results and prediction. 

When the concept of reliability growtli testing was conceived (i.e., 
the text-f i v-Lost-f i X philosophy) it was advanced as a means of arriving 
at a higji Ic-vo. 1 of reliability during the development cycle; a level 
\;hieh would translate into field reliability witli little or no de- 
grndalion. Actual field experience lias not liorne outl tliese optimi.stic 
expectations . 

One tnctieal radar, for example, was sulijected to the type of testing 
oulliiKul above, for a total of 848/-I I.oiirs in tlie factory. Under !:his 
testing which involved .some 5^i systems, an iriBF of 061 lioiirs was aehievc'd 
at the 90% confidc^nco level. It should be noted that these tests were 
conducted in a MlL-STD-781 environment. 
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Several years later, these same radars exliibitcd a reliability 
of only 26 MFliBF (Mean )‘li[;ht Hour Between Failure) on one type of 
aircraft and 33 MFHBF on another type of aircraft accordin[i to USAF 
66*1 data collection system. This represents a degradation of about 
5 to 1 over the laboratory test results vdiich illustrate the uncer- 
tainty Involved in predicting field MTBF based on laboratory results. 

This example should not be taken as a condemnation of the reliability 
growth test philosophy however, since this system exhibited a field 
reliability about 3 times that of similar systems which had not been 
through this experience. 

This example is not an isloatcd case. Another contemporary 
tactical rad<u' \;hich received much emphasis on reliability during 
devclopmcMit , including reliability growth testing, again exliibited 
a dogr*ulation of ‘about A to 1 from lab to field. Other examples have 
been noted where degradation as high as 15 to 1 have been experienced. 

It should be obvious, therefore, that a FFP RIW quote prior to 
full scale development is inordinately risky. Further a FFP KIV; 
goal ]>ased on laboratory testing and prior to operational testing 
is not a viable alternative. 

\'/lille the risk involved in predicting the operational MTB]' (the 
ba.sis for a )vIW quote) is certainly greatest in newly devclopcul equip- 
ment, a substantial risk is still prer.ent when equipment is "simply” ' 
redesigned, repackaged or even utilized in a different type of vehicle. 
Redesigning or repackaging may sufficiently alter cooling, vibration 
and shock modes, operator involvement, etc., in such a way as to grossly 
affect field MTUF. Simply moving tlie equipment from one type of vehicle 
to anol.lier may alter the environment and appreciably affect the re- 
liability . 

An obvious example would be the use of 66-1 data taken on a navi- 
gation system in a transport aircraft and using it to predict the 
reliability of tiiat same system in a fighter aircraft. It should be 
stated that the 66-1 data in itself is subject to some question as an 
accurate measure of field reliability since its validity and accuracy 
are affected by sucli factors as retest OKs, conseciuent ial failures, 
lad: of good failure mode data, and opcrator-and-maintenanco- induced 
failures resulting from the inexperience of organic field maintenance 
teams, and/or operator-users . 

In addressing the general subject of risks involved with t)je KIU 
concept, i t is a fact that very little actual experience exists in the 
use of RIW by the military. It appears that only two USAF i')rograms have. 
provided some limited experience. 

It would appear that with the scant amount of RIW experience at hand, 
it would he well to proceed slowly and cautiously on RIW until a larger 
data base is available. 
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In summary, the USAF motivated by valid concerns, would prefer 
gn ^arly industry commitment to RIW. Industry understands this pre- 
ference but fears the risk involved in such a commitment, as exemplified 
fey several recent significant procurement implementations. Happily,, 
l^Qwever, we believe this USAF/ industry dichotomy can be resolved to the 
gatisfaction of both partied by a contractual technique of progressive 
gpplication of RIW, This technique would vary somewhat depending on 
th? of program involved. 

g General Approach and Rationale 

In situations involving the design/development /production cycle, 
gn RIW cost goal (similar to a unit production cost goal) v/ould be 
get early, A meaningful or positive incentive would be tied to the 
|.ater achievement of that goal. Depending on the. type of program in- 
volved, the incentive would be monitory or continue participation in 

program. In any event, the development and early production phases 
^u§t' include expanded development laboratory and field reliability 
Resting v/ith adequate time and funds to accomplish this testing. It 
i§ particularly important that the Government be prepared to allow the 
ppst of adequate component testing and development {as a separate 
contract line item where appropriate) such that design tradeoffs can 
be made early and on the basis of empirical data. 

A properly applied RIW should have two favorable impacts on 
reliability; (1) during the critical design, development and test 
phase of a program, RIW should provide the opportunity for a practical 
and achievable incentive to the contractor under a CPIF form of con- 
tract to build reliability and maintainability into the hardware and 
(2) after the equipment is operational, RIV/ sliould provide an incentive 
for continued reliability improvement. This latter improvement is 
achieved through a properly applied firm fixed price type RIW contract, 
(i.e., after f ield-validated test results are in hand) under which 
the contractor must balance the cost of continued repairs against the 
cost of reliability improvement changes. In order to reduce his 
total cost under the RIW it is anticipated that the contractor wi].l 
indeed make field changes which will incrementally result in improved 
reliability. 

Of these two impacts on reliability, undoubtedly the greatest po- 
tential impact is achieved during the design, development, and test 
phase of a program. For this reason the USAF has, in some recent pro- 
curements, requested FFP RIW options at a program milestone prior to 
full scale development (FSD) of hardware. 

On the other hand, industry considers the risk associated with the 
premature (i.e., pre FSD.& operational test) commitment to RIW on a FFP 
basis to be unduly high. This is particularly true where new develop- 
ment is involved, however, repackaging or use in a different application 
may render historical reliability data invalid. 
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A resolution of this dichotomy would be to establish RIW goals 
only during the development program tied to a realistic incentive if 
the goals are met. Tlie development acquisition cycle should include 
a test of production type hardware in an operational environment, 
during which test field reliability would be measured. The incentive 
should be based on how well these test results match the development 
goals and the FFP RIW quote would also be based on the results of this 
test. 



Achievement of the developmental RIW goal would be measured against 
actual performance of pilot production hardware (or preproduction pro- 
totype hardv^are if the task is considered to be an expansion/extension 

of the development phase) in the operational use environment. 

« 

The FFP RIW would he quoted at the termination of the operational 
test period and would utilize contractor-acquired and analyzed field 
failure data accumulated during this test. Incentive payment would 
also be based on how well the development goal matched the actual per- 
formance in the operational test. It is believed that a development 
program structured as outlined above would reduce the risk to a manage- 
able level. 

Proeurements which involve only production of additional quantities 
of hardware which had been previously fielded may be amenable to FFP 
RIW without the test phase outlined above. This application docs not 
offer optimum utilization of RIW however since it comes too late in 
time to influence rcli<ihility during the dcvelopmcut/design phase. 

Only the results of the reliability growth pliasc of RIW could be realized. 

o .Specific Approaches 

In any event, the detailed mechanics of applying tlie proposed RIW 
plan will vary somewhat depending on the type of program involved. 

Three types of programs will be considered for more detailed discussion. 

^ • P<Tt“allel Development Program 

A. Parallel development program is defined as one in which two 
or more competing suppliers are carried through full scale development 
and at least up to the production decision point (DSARC III). 

In such a program, it would be assumed that the USAF, in using 
RIW, would be interested not only in the lowest possible OfrM costs 
but also in aehievement of tlic lowest Life Cycle Cost (LCC) . RIW,. then, 
is a means of bringing more realism to the costing of tlic operational 
phase of the program’s life cycle. 

In the parallel development program, goals Cot total Life Cycle 
Cost \>’ouid be set at the beginning of the program. The competitors 
would then be encouraged to trade off unit production cost goals against 
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siipport cost goals including an RIW goal (repair cost) in order to arrive 
at the lowest LCC. Competition v/ill insure that the RIW and unit pro- 
duction cost goals are optimized for USAF requirements. The development 
phase would then be expanded to include field tests of all competitors 
hardware using either preproduction prototypes or pilot production 
hardware built, for this purpose. In any event, the hardware used in 
these tests v;ould be built to production drawings and with production 
tooling. The tests would be conducted in an actual operational environment 
and using operational type personnel. The results of those tests would 
assure the USAF of the realism of the competitor's reliability claims 
and would at the same time reduce the risk associated with the FFP RIW 
quote for industry. No incentive is more powerful at this stage than 
the desire on the part of the competitors to win the production award. 

The USAF would then obtain more realistic (i.e., contingency-free) FFP 
RIW' quotes from the competitors, and would buy production hardware with 
RIW from the supplier offering the lowest LCC. 

Using the above technique, the risk associated with FFP RIW would 
be reduced to a manageable level for industry while at the sane time, 
the USAF would be assured by the competition of a reliable design with 
the lov/est practical RIW cost. The use of parallel development is 
highly recommended wherever possible. 

Although this technique requires a larger cash outlay initially. 

It would no doubt result in the lowest life cycle cost in the long run. 

It is recognized, however, that the initial outlay of larSe develop- 
ment funds is often viewed with a jaundiced eye by RDT&E fund custodians, 
Congress and others in the approval cycle. Nevertheless this outlay, 
in our judgment, must be regarded, not as out-of-pockat expense, but 
rather as investment in the future, with gains to be realized and measured 
in terms of enhanced equipment availability and lowered O&M costs. 

2. Competitive Single Development Program 



The competitive single development program is defined as one in 
which competition exists only through the early stages but not to full 
scale development. Because of the difficulty in obtaining the large 
outlay of front end money associated with parallel development, this 
is the type of program most frequently encountered in major weapons 
system programs. 

With the competitive single development program, RIW goals would 
be set early and would emphasize the importance of reliability and 
Life Cycle Cost during the critical design and development phase. In 
this type program, the realism of these goals would be insured by 
applying a significant monetary incentive (not penalty) to the achieve- 
ment of the goal. 

As in the case of parallel development, preproduction prototypes 
built to production drawings and tooling or pilot production articles 
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would be subjected to the field reliability test described previously. 
Again the field test would be carried out in an operational environment 
using tailitary personnel. 

The' FFP RIV7 quote would utilize the operational MTBF determiried 
by the above test results. Using the same test results, the RIW 
Incentive payiaent would be based on the relationship between the goal 
established early in the program and the FFP RIW established above. 

With this technique, the USAF desire to introduce the RIW con- 
cept early enough to influence the design would be satisfied, while 
at the same time, industry's risk v;ould be reduced to a manageable 

level. 

3. Competitive Production Program 

Let us consider two instances of a competitive production program: 

(a) In the first instance it is defined as a competitive procure- 
ment of additional quantities of an article already in production 

and' already fielded. 

(b) The second definition of a competitive production program 

is one in which there is a multi-source competition for the production 
of an article developed by one firm but not yet developed into opera- 
tional use. We do not recommend the application of RIW to either of 
these programs for a number of reasons, the most significant of which 
are: 

1. ') In the first case the potential for reliability growth 
. . would be limited and configuration control management 

would offset savings, and, in the second cited instance, 

2. ) Complex hardware, while lending itself to RIW by the 

developer does not provide adequate data to the competition 
to constitute a reasonable risk. 

A. Definition of "Development" from a Technology Viewpoint 

For the purpose of RIW, "development" is simply defined as any 
program resulting in hardware sufficiently different in form, fit 
and function from previously developed/deployed hardware as to require 
a formal design and/or environmental qualification test program prior 
to the device becoming operational. 

This definition then applies not only to hardware involving new 
advanced technology and concepts, but could also encompass the following 

(a) Redesigns of existing hardware to modernize the circuitry 
(i.e., change from vacuum tube or discrete component cir- 
cuitry to integrated circuitry).. 
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(b) Mechanical repackaging to change the form factor for a new 
application. 

B, Options 

The FFP RIW option is a firm commitment, and should be quoted 
only when the MTBF/RIW Cost is "reasonably predictable" as previously 
described. On programs involving development this occurs only after 
reliability data has been accumulated from operational tests and analysed 
by the contractor. 

1, Selective Exercise 

Two definitions of "selective exercise" have been considered. 

The 'preferable definition is one in vjhich the seller is asked to quote 
FFP RIW options for successive Ff buys of equipment after completion 
of the operational tests previously discussed. Industry has no ob- 
jection to use of such options provided that, in consideration of 
technical and economic factors, the price for the options is subject 
to redetermination and adjustment at successive periods to be set 
forth in the contract. 

The second definition of "selective exercise" involves the case 
where the buyer is permitted to apply RIW selectively to portions 
of the equipment under procurement. This represents a situation which 
is unsatisfactory to industry since: . . 

(a) It presupposes commitment prior to the availability of field 
MTBF data, and 

(b) It may permit the buyer to select only the low reliability 
portions of the equipment for the RIW. Thus, while the equipment 

as a whole may exhibit quite satisfactory reliability, the supplier 
is saddled with maintenance cost of the less reliable portion. It 
would also seem that this would be undesirable from a government viev;- 
point because of the elimination of hardware items whose field reliability 
could be improved through RIW. 

2. Exercise Restrictions 

As outlined above, options should not be required until field re- 
liability data is available. The exercise of options should be re- 
stricted to purchase of RIW for successive FY buys of production hard- 
ware only. 

C. How Long a Warranty 

The warranty period should extend for several years, the exact 
time being dependent on the type of product involved and its application. 
The period must be long enough to allow the development of a valid field 
data base '.■.■’hic!i will permit the practicable trade off between cost of 
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design changes and cost of repairs. This Is the key to the "I" (improve 
ment) in RIW. Only through failure analysis and possible redesign can 
improvements be made. The actual vrarranty length will depend on Che 
usage factor, storage time, expected failure rate, maintenance concept, 

etc. 



D. Termination of V?arrantv 

The most economical approach for the DSAF would be to renev; the 
warranty prior to the expiration of the initial warranty period. Ne- 
gotiation of the warranty renewal terms must be started prior the last 
year of the initial warranty period. This approach would: 

1. Reduce the heavy salary and pension commitment by USAF for 
support personnel 

2. Minimize the need to purchase organic maintenance training 
programs, maintenance handbooks, intermediate and depot level 
test equipment, etc. 

3. Insure continued maintenance by liighly qualified, well trained 
and experienced contractor personnel. 

A. Eliminate the need for spare parts cataloging, inventory pipe- 
lines and reduce spare LRU (Line Replacement Unit) requirements 

5. Have a gradual and manageable impact- on present organic depot 
facilities and personnel since primarily nev;er systems would 
have RIV7. 

• If the RIW program is terminated and organic maintenance imple- 
mented , then provisions should be made in the initial procurement for 
the orderly phasirg-in of US.\F maintenance. 



103 




II 



T/iCflCU Airi50rjii-. R.\DAI?S 




crt 

8 



o 

y 



vnUT \rE, SPECIFY 



- 11 - 



II. RIW CONTRACTINCI BASIS: 

A, Typa of Contract 

To provide the flexibility needed to procure the various DoD re- 
quirOfflOnts, ASPR (3-401) has established a wide selection of contract 
typod* At one extreme is the firm fixed price type which is used when 
thero are reasonably definite design or specification requirements and 
the costs can reasonably be determined and the contractor can there- 
fore accept full cost responsibility* At the other extreme is the cost 
plus fixed fee type which is used when the uncertainties are of such 
a magnitude that costs cannot be estimated with sufficient reasonable- 
ness to ensure an acceptable risk to the buyer and seller. In this 
casCi the fee rather than price is fixed and the contractor’s cost 
responsibility is minimized. ASPR (3-401) further states that v:hen 
the risk is minimal or can be predicted with an acceptable degree of 
certainty^ a firm fixed price contract is preferred. However, as the 
uncertainties become more significant, other fixed price or cost type 
contracts should be used to avoid placing too great a risk on the con- 
tractor. 

It is within this framework that we must look for the appropriate 
contract type to be used for RIW contracting at various stages of 
equipment design development, production, and operational deplojnnent. 

1» RDT&E Design Phase 

The design and development phase of any program which involves new 
technology or new applications of existing technology carries with it 
a Significant amount of uncertainty. It has usually been the practice 
for the services to contract for this phase utilizing a cost reimbursable 
type of contract which is compatible with the ASPR. We have not generally 
experienced, nor do we envision that a change is justifiable in the 
basic method of contracting for research and development with the ad- 
vent of RIW. In fact the uncertainties of equipment field performance, 
namely OTBF, during this phase mandates the use of cost reimbursement 
contracts . 

2, Production Phase 

We are also concerned with the method of contracting for the 
next phase — Production. At this phase, without an RIW requirement, 
the design and specification requirements would have been finalized 
through adequate testing and the costs of production could be reason- 
ably determined. However, the imposition of RIW on a fixed-price basis 
at this time introduces unkno\>ms of considerable magnitude. There- 
fore the use of a form of cost-reimbursement contract continues to be 
necessary during the production phase. A fixed price RIW contract, in 
addition to being contrary to ASPR and DoD Directive- 5000.1, is con- 
trary to tlie application criteria set forth in the RIW Guidelines. 

These guidelines, among other things, that the fieief reliability, costs 
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§6-§«pp6f€ the equipment, and potential for reliability growth will 
reasonably predictable at the time the firm fixed price bid is 
Side; Without field reliability data, the contractor cannot reason- 
afely predict either the costs of support for the potential span of 
fdiiabiiity growth. If he cannot reasonably predict these items, the 
fgwards and risks to industry and the government cannot be balanced 
§0 Ihal they are acceptable and equitable to both. 

ft® §ASD (I&L) memorandum, dated 16 September 1975 which was 
ifil§nded to clarify the guidelines, recognized and supported this 
Position; however, enclosure I thereto seems to take an opposite 
Vi&w; This enclosure states that R.IW can be applied to any new 
g^Uipmehti even if the design utilizes new technology and there is 
fl6 previous experience. It implies that lack of actual experience 
6ah Be overcome if there is adequate laboratory development time 
and Eestihg. But, it goes on to note that considerable latitude 
gxists in tailoring the terms and conditions to the uncertainties. 

B6me examples are: (1) the reliability guarantee can be tailored, 

^2} turnaround time can be varied, (3) exclusions can be adjusted 
t6 fit the situation, and (4) the initial commitment can be limited 
t6 the initial production buy. In general, the greater the uncer- 
taihtiesi the less stringent would be the warranty terms. If it is 
edheeded that this depth of tailoring is necessary due to uncertainties, 
a ebsfc type contract for RIV7 would be more appropriate and we offer 
the following alternative for your consideration. 

The design and development cost reimbursable contract v;ould 
appropriately contain a RIW goal with positive incentives to mo- 
tivate the contractor to apply resources to the area of equipment 
reliability. This should be followed by the purchase of a limited 
number of production units, either under an extension of the develop- 
ment contract or an initial production contract. We feel that a 
cost reimbursable type contract is most appropriate because it is 
during this field-test-before warranty phase that the contractor 
would be acquiring field operational data and making design improve- 
ments to enhance reliability. This "bridging’* phase is essential 
because historically it has been proven that even the most stringent 
development' testing in a lab environment is not a cdnclusive quanti- 
fication of the operational field environment, nor can reliable and 
valid extrapolations be made from the former to the latter. In this 
way the unacceptable financial risk of premature cost commitments, 
is minimized during the period where there are many uncertainties, 
with firm RIW pricing to follow when appropriate data and experience 
have been completed, 

B. jncentive Structure 

DoD, in its incentive contracting guide, states that profit, 
generally, is the basic motivator of business; and, the profit motivator 
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Is^the essence of incentive contfacllng* Howevefi Industry and the 
governr*ent have had both good and bad experiences in the use of In- 
centives. The unsuccessful ones can be attributed to complex incen- 
tive structures which were difficuit to adminster and were manipulated 
by the parties. 

In spite of these bad experiences ^ ve believe that multiple in- 
centive cost reimbursable contracts - with proper v;eighting between cost 
incentives and demonstrated MTBF - can motivate contractors to make 
trade offs between increased design costs and lower support costs in 
favor of MTBF. Properly structured incentives under the cost type 
contract can achieve the same results as early fixed price RlW con- 
tracts with the proper balance of risk betv/een the GontfaCter and the 
government . 

As incremental improvements in MTBF are mote difficult to achieve, 
a curvilinear structure would theoretically be a more appropriate and 
motivational form of incentive. However, to date, there has been 
little, if any, use of the curvilinear incentive structure and, there- 
fore, inadequate experience upon which to recommend it. Rather, we 
would recommend the more conventional linear structure for use with 
RIW. 



C. REWARD/PENALTY RELATIONSHIP 

The RIW clauses which we have observed to date in RFP and con- 
tracts are, from our perspective, using penalties rather than rewards, 
to motivate the contractor. We do not mean to imply that rewards by 
definition are not provided, but the probability of a contractor 
achieving them are slim particularly if the penalty/reward curve is 
skewed toward the former. 

The following are representative examples that have appeared in 
recent hardware procurements ; 

1. Failure cause exclusions are very limited and the contractor 
must establish by "clear and convincing evidence" that any 
of the exclusions are applicable. Such matters as improper 
installation, operation or maintenance, as well as the nor- 
mal range of events covered by force majeure are not covered. 
Further, the standard of proof required would be extremely 
difficult for the contractor to meet considering the fact 
that the equipment will have been operated solely under the 
control of military personnel. 

2. Contractors are faced with accepting turn-around times (TAT) 
of 15 to 20 days for complex "black-boxes" or risk being 
non-responsive. Then, if they miss the TAT, they are assessed 
liquidated damages for each day in excess of the specified 
limit . 
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' ^^-3# — Basic to the RIW clause is the requirement for the contractor 
to repair or replace all units that fail (except for limited 
specific failure causes) even though caused by Service personnel. 
Not only does this result in the contractor incurring expense 
to repair but it also directly influences (negatively) the 
operational HTBF and therefore the associated penalties. 

4* The contractor is required to guarantee an initial MTEF with 
in escalating MTBF value each year through. 48 months of 
warranty. In the event that the MTBF guarantee is not achieved, 
consignment units are to be supplied at no cost to the 
government. Delivery of these units is subject to liquidated 
damages of a specified percentage of unit price per day to 
1 maximum of a specified high percentage of the unit price. 

This penalty is usually based upon a short delivery require- 
ment both for in-production and out-of-production units. 

If Che contractor fails to achieve the guaranteed MTBF over 
the life of warranty, the consignment units become the 
property of the government at no additional cost. 

These clauses may not be as objectionable to a contractor if 
field operational test data were available on which to base his price, 
hoWeVer, without this data they may be more likely to become penalties. 

OnCe again, if the implementation of RIW by fixed price contracting 
Vefe delayed pending availability of field, operational test data, 
the probability of a more equitable balance between reward and penalty 
W’ould be greater and hence more acceptable to the contractor. 

III. MTBF REQUIREMENT * 

Afc Should the Government specify a minimum MTBF? (point, growth, 
or at all) . 

In considering a contractual requirement for RIW, the anticipated 
MTBF is the key ingredient in determining the selling price of the RIW. 

Tn a competitive procurement therefore, in order to insure that all 
competitors are striving for the same reliability target, it would 
seem desirable that the government specify a minimally acceptable MTBF 
goal together with a growth range (e.g., 800-1000 hours). It is recommended 
that this goal be set as described in the section of this report dealing 
with “Joint DoD/lndustry Ombudsman". Briefly, the government vrould 
set a tentative value for the OTBF goal based on applicable historical 



^ Both MTBF (Mean Time Between Failures in operational hours) and 

OTHBF (Mean Flight Hour Between Failure) have been used to determine 
^reliability . We are referring here only to MTBF because it is common 
p^ractice to operate equipment at times other than during flight. 
Accordingly, hours in flight may represent only a fraction of total 
operation time. Further, the method of accurately computing 'MBF 
must be specified, and the use of running time tnecers should be a 
requirement whenever technically feasible. The accuracy of any 
alternate system must be subject to contractor approval. 
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data, etc., and release this to the competitors prior to release of the 
RFP for their conmient and tuning. The IIFP HTBF goal would then re- 
flect this value. Inclusion of a growth range would provide flexi- ’ 
bility to the competitors in doing their tradeoffs of unit production 
cost and LCC. • 

I 

♦ 

Another possible reason for the government specifying a MTBF would 
be for guaranteed MTBF (GMTBF). Industry feels that the imposition of 
both RIV7 and GITTBF on the same contract places the contractor in double 
jeopardy and greatly multiplies the risks involved. Of the two plans 
for improvement in field reliability, the RIU is by far the most acceptable 
to Industry. In no event, however, should both plans be imposed on the 
same contract. 

If a GMTBF is to be used in lieu of a RIW, it is recommended that 
the value be set as follows: 

What Kind of OTBF 

It is recommended that the specified >ITBF be set in the same fashion 
as described previously for setting the RIW price, i.e., an >riBF goal 
should be set prior to the design/development stage. Incentives should 
be applied to the meeting of that goal. The firm GMTBF value should 
however not be set until operational type testing has been performed • 
on equipment similar to production hard;;are; and the final GMIBF value 
should be based on the results of those tests. The rationale is identical 
to that given for RIW in the section on “Timing of RIW Application". 

Although the operational type of test is essential to the proper 
setting of the GMTBF value, MIL-STD-781 reliability growth testing should 
not be abandoned since it is an essential part of any development pro- 
gram aiming at a high field reliability. As noted elsewhere in this 
report, although MIL-STD-781 test results have not been directly corre- 
latable with field reliability, they have proven to be a means of weeding 
out many failure modes during the development period, and therefore, 
funding and time should continue to be supplied for these tests. 

C. When Should it be Applied? Successive Targets? 

Industry feels that if a GMTBF is to be used, the successive target 
approach, coupled with a high degree of contractor freedom in introducing 
design changes during the successive measurement periods, is the most 
productive one for both industry and government. 

For the government, it provides some of the same reliability growth 
features inherent in the RIW concept; while for industry it provides 
a realistic and attainable initial target, thus permitting time to dis- 
cover some of the unknowns involved in extensive and varied field use 
of the product. At the same time the achievement of a higher final MTBF 
value will result because of the learning time than would be achieved 
if a point target only were involved. 
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D • "Joint DoD/Industry Oirhudsman 

We believe that a joint DoD/Industry ombudsman group, altnough 
mutually beneficial in some situations, c,g., policy or regulation re- 
view, is not appropriate for the task of "scrubbing down" MTBF require- 
ments in the solicitation. 

The use of an "independent consultant" (i.e., not one of the 
competitors) raises questions of qualification, competency, and what 
might be called "respons^ibility to client" if the consultant were to 
be engaged by the government. Also, it must be recognized that such 
a consultant assumed no risk under a contractually binding commitment. 
For these reasons, we recommend against the use of such a consultant. 

There are alternatives current available to the services which 
should effectively accomplish the same end. * 

For example, the Department of Defense Directive A105.62, dated 
January 6, 1976 furnishes a mechanism for reviewing requirements within 
DoD and for utilization of industry input in arriving at the decision. 
Subparagraph III.D.2.h(2) provides for the establishment of a Review 
Board that, "Shall insure that specification requirements have been 
thoroughly examined and justified for the purpose of eliminating non- 
essential or unduly restrictive requirements and that the solicitation 
requirements have been correlated with the operational needs." 

Subparagraph III,C.2.h. (5) establishes a requirement that each 
solicitation provide for industry feedback from prospective contractors 
prior to the proposal due date. Also, the services have implemented 
a prerelease of the REP requirements for industry review and input. 

We recommend the above methods in lieu of the ombudsman group as 
a means of making industry input’ available to the services for their 
use in arriving at a final decision. At the same time it does not 
have the drawback of potential conflict of interest that a joint group 
would have. 

IV. FAILURE: 



A. Definition 

The key to verification of an operational MTBF is the definition 
of failure used to compute the MTBF. This definition must include 
what is counted as a failure and what is excluded as a failure. A 
failure is defined as "any departure from the required performance in 
excess of the allowable tolerances, defined in the equipment configura- 
tion item design and test specification due to its own internal failure." 
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1* Exclusions 

The contractor should not be obligated to correct, replace, or pro- 
pose ECP actions at no cost to the government with respect to any hard- 
ware item under RIW nonconformance, loss or damage by reason of: 

(a) Fire 

(b) Explosion 

(c) Submersion 

(d) Flood 

(e) Aircraft (vehicle) crash 

(f) Enemy action 

(g) Seal broken on unit while outside contractor’s control 

(h) External physical damage caused by accidental or wilful mis- 
treatment 

(i) Internal physical damage caused by accompanying external 
physical damage due to mistreatment or to tampering by non- 
contractor personnel 

(j) Act of God 

(k) Induced failures. Failures of hardware items induced by mal- 
function or improper operation of outside .(system interfacing) 
units 

(l) Consequential/ incidental damages 

(m) Unverified failures (i.e,, the item ”retest okay") 

(n) Improper installation/ operation/or maintenance 

(o) Having been designed or developed or produced by others than ’ 
the warrantor. 

Repair/replacement actions taken by the contractor v;ith respect to 
hardware items damages by and/or subjected to these above-excluded cir- 
cumstances/clauses/conditions should be compensated by an equitable 
adjustment in applicable contract provisions including but not limited 
to price. 

ECPs prepared to affect design changes aimed at precluding future 
failures related to these excluded causes/circumstances/conditions 
and/or which have the effect of changing the design and/or environmental 
specifications under which the hardware item was initially procured, 
should, for the purposes of RIW, be considered as relating to exclusions 
and thus be subject to negotiation and equitable contract adjustment. 

In RIW program management practice, there would be a presumption 
that all candidate hardware items returned during the RIW period would 
be covered under the warranty, and the contractor would be expected to 
proceed to take those expedited actions most advantageous to the govern- 
ment's operational status. However, if such actions were taken in good 
faith on hardware items ultimately determined, through contractor failure 
mode analyses, to be subject to any of the excluded conditions/causes/ 
circumstances cited above, there should be no presumtpion of his non- 
entitlement to the equitable adjustment provisions of the contract. 
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However, the contractor must present evidence to substantiate 
an exclusion and the government must have a designated individual 
with the authority to approve or disapprove the exclusion. The con- 
tractor should have the right to place contractor personnel at any 
location at Government expense where there is evidence that OSM re-‘ 
porting is erroneous (66-1 system) or that conditions (set forth in 
Section IV. A) under which the contractor is not responsible may have 
existed but were not reported. 

Those units returned to the contractor, which fall under exclusions, 
should be referred iminediately to the AGO and PCO for resolution. Only 
those failures occurring subsequent to final acceptance should be in- 
cluded in the RIW Program. Only through such rigorous control can 
the manufacturer assure that proper maintenance is being conducted on 
his warranted iteni(s). The repair cost of excluded failures should 
be covered by a separate clause or contract. 

All failed units returned to the contractor should be accompanied 
by a statement of failure mode, operational and test data, etc., com- 
pleted accurately and comprehensively utilizing contractor recommended 
testing facilities, equipment and procedures. 

The verification of failure should be perforTned by a method agreed 
to by both the government and the contractor. The use of built-in- 
test (BIT), based on past BIT capability, would rule this out as an 
acceptable metliod to both parties. The use of detailed acceptance 
test procedures and an intermediate or depot manufacturing tester would 
probably be the minimum test method for failure verification acceptable 
to both parties. 

2 4 Degree of Control, Government vs. Contractor 



Interface and authority/responsibility patterns between organic 
maintenance functions and warrantor must be clearly defined. The govern- 
ment must be prepared in this area to make hard decisions concerning 
a possible revamping of traditional organic maintenance and support 
functions now held closely by the services, in favor of an augumented 
role in these areas of the design authority - viz., the contractor. This 
is true because the contractor perceives his risk to be greater or less 
in direct proportion to the degree and extent of his involvement in 
field operations and logistics management activities. Also, because 
the field reliability/dcsign loop is best closed by the mechanism of 
coherent contractor management of field service/design organization 
activities . 

The warrantor should have complete visibility and requisite control 
over assets management (handling of hardware, recording and validation 
of failure data, fault mode analysis, pipeline spares management, access 
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to government records, etc.) during the field-test-before-warranty 
phase as well as during the long-term RIW phase production/spares con- 
tracts. 

3 * Timing, Responsibility Vesting 

Tum-around time (TAT) for each warranted item should be agreed 
to by the government and industry preferably as a range or band of 
time (e.g., 21-30 days). The TAT "clock'* (i.e., start of contractor 
responsibility) should start upon date of receipt of the warrantable 
asset (s) as verified by the, AGO* s representative, at the contractor's 
repair facility, also to be contractually designated. 

Responsibility for control of the asset (s) should be considered 
to be transferred back to the government effective with turnover to 
the resident government inspection and acceptance authority at the con- 
tractor's repair facility. Shipments should be made F.O.B. contractor's 
plant on a Government Bill of Lading. 

TAT performance should be assessed and measured over the whole 
warranty population and period - not on an individual return basis. 
Evaluation of TAT performance should be made on the basis of the average 
of all item returns to determine that such average TAT fell within 
the contractually established time band. Penalties for exceeding the 
upper limit of the TAT band should be assessed only if it can be con- 
clusively established that the delay was caused by or attributable to 
gross failure, negligence or to the chronic lack of managerial diligence 
on the part of the contractor's managers. Assessment of liquidated 
damages in connection with TAT is unjustifiable in any case since this 
would result in double jeopardy in conjunction with requirements for 
consignment spares. 

4. Retest O.K. 



Excessive retest okay equipments are a problem to both the 
government (increased pipeline, low availability) and the contractor 
(cost of testing). Therefore, the government should be required to 
pay the contractor for each returned equipment that retests okay. The 
value should be large enough to compensate the contractor for the 
cost of testing and to encourage/force the government to perform adequate 
testing at the base level to reduce the number of retest okay returns. 
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